GPTBot
OpenAI · LLM training crawler
111 of 1195 monitored sites (9.3%) block GPTBot by name, 4 restrict it.
GPTBot blocking over time share of monitored sites · weekly snapshot
Sites blocking
GPTBot
2026-06-23
2026-08-04
19 earlier weeks omitted (archive building) · 7 weekly snapshots with reliable coverage
Recent GPTBot events
- 2026-08-04 — Zscaler: Added rules for AI crawler GPTBot (OpenAI) diff
- 2026-08-04 — Commonwealth Bank: Added rules for AI crawler GPTBot (OpenAI) diff
- 2026-08-03 — Tanium: Added rules for AI crawler GPTBot (OpenAI) diff
- 2026-07-31 — Morgan Stanley: Added rules for AI crawler GPTBot (OpenAI) diff
- 2026-07-29 — BBC: Added Allow: /storyworks for GPTBot; Added Allow: /storyworks/ for GPTBot diff
- 2026-07-29 — Lithia Motors: Blocked GPTBot (OpenAI) entirely diff
- 2026-07-22 — USA Today: Added Allow: /money/money-management/ for GPTBot diff
- 2026-07-22 — Roblox: Unblocked GPTBot (OpenAI) - rules removed diff
- 2026-07-21 — Roblox: Blocked GPTBot (OpenAI) entirely diff
- 2026-07-21 — Roblox: Unblocked GPTBot (OpenAI) - rules removed diff
- 2026-07-20 — Waldo: Added rules for AI crawler GPTBot (OpenAI) diff
- 2026-07-20 — Roblox: Blocked GPTBot (OpenAI) entirely diff
- 2026-07-18 — Ford Motor: Removed rules for AI crawler GPTBot (OpenAI) diff
- 2026-07-16 — Europe PMC: Added rules for AI crawler GPTBot (OpenAI) diff
- 2026-07-16 — Ford Motor: Added rules for AI crawler GPTBot (OpenAI) diff
- 2026-07-16 — Europe PMC: Removed rules for AI crawler GPTBot (OpenAI) diff
- 2026-07-11 — Hulu: Removed Disallow: /start for GPTBot diff
- 2026-07-08 — Huntington Ingalls Industries: Added rules for AI crawler GPTBot (OpenAI) diff
- 2026-07-02 — Kuehne+Nagel: Added rules for AI crawler GPTBot (OpenAI) diff
- 2026-07-01 — Fortra: Blocked GPTBot (OpenAI) entirely diff
- 2026-06-29 — Kimberly-Clark: Blocked GPTBot (OpenAI) entirely; Removed Allow: / for GPTBot diff
- 2026-06-27 — Grupo Bimbo: Added rules for AI crawler GPTBot (OpenAI) diff
- 2026-06-27 — DataDome: Added rules for AI crawler GPTBot (OpenAI) diff
- 2026-06-24 — Ireland (Gov.ie): Blocked GPTBot (OpenAI) entirely diff
- 2026-06-17 — W.W. Grainger: Blocked GPTBot (OpenAI) entirely diff
- 2026-06-17 — Regeneron Pharmaceuticals: Added rules for AI crawler GPTBot (OpenAI) diff
- 2026-06-17 — Evonik: Added rules for AI crawler GPTBot (OpenAI) diff
- 2026-06-17 — Nikkei: Blocked GPTBot (OpenAI) entirely diff
- 2026-06-17 — Khan Academy: Blocked GPTBot (OpenAI) entirely diff
Sites blocking GPTBot
| Site | Sector | Badge |
|---|---|---|
| ABC News | Broadcast News |  |
| Academia.edu | Research network |  |
| Adobe Stock | Stock media |  |
| AI21 Labs | LLM |  |
| Al Jazeera | Broadcast News |  |
| Alibaba Group | E-commerce |  |
| Amazon | Retailing |  |
| ArcelorMittal | Steel |  |
| Archive of Our Own | Books |  |
| Arrow Electronics | Technology |  |
| Bandcamp | Music |  |
| Baxter International | Health Care |  |
| BBC | Broadcast News |  |
| Behance | Graphics Multimedia and Web Design |  |
| bioRxiv | Preprint server |  |
| Bloomberg | News & Financial |  |
| Burlington Stores | Retailing |  |
| BuzzFeed | Digital Media |  |
| Canva | Web |  |
| CBS News | Broadcast News |  |
| Claude | LLM |  |
| CNN | Broadcast News |  |
| Corriere della Sera | News |  |
| Costa Rica (Presidencia) | Americas |  |
| Daily Mail | News |  |
| De Telegraaf | News |  |
| Der Spiegel | News |  |
| Die Zeit | News |  |
| Disney | Web |  |
| DOAJ | Open access directory |  |
| eBay | Technology |  |
| EPFL | University |  |
| ESPN | Web |  |
| Expeditors International | Transportation |  |
| Figma Community | Graphics Multimedia and Web Design |  |
| Forbes | Business |  |
| Fortra | Cybersecurity |  |
| Genius | Music |  |
| Globo | Web |  |
| Goodreads | Books |  |
| Grok | LLM |  |
| Guyana (Office of the President) | Americas |  |
| HuffPost | Digital Media |  |
| Iceland (Government.is) | Europe |  |
| IGN | Web |  |
| Social Network |  | |
| Ireland (Gov.ie) | Europe |  |
| Khan Academy | Education |  |
| Kimberly-Clark | Consumer Goods |  |
| Le Figaro | News |  |
| Letterboxd | Arts and Entertainment |  |
| Professional Network |  | |
| Lithia Motors | Retailing |  |
| Los Angeles Times | News |  |
| Lufthansa Group | Airlines |  |
| Mastodon | Social Network (Fediverse) |  |
| Medium | Publishing |  |
| Mercado Libre | E-commerce |  |
| Midjourney | LLM |  |
| Msn | Web |  |
| NBC News | Broadcast News |  |
| Newsweek | Magazine |  |
| Nextdoor | Social Network |  |
| Nikkei | News & Financial |  |
| Nintendo | Video Games |  |
| Northrop Grumman | Aerospace & Defense |  |
| NPR | Public Radio |  |
| PG&E | Energy |  |
| Pixiv | Art |  |
| Politico | News |  |
| Pond5 | Stock media |  |
| Prudential Financial | Financials |  |
| Quora | Q&A |  |
| Sempra | Energy |  |
| Shutterstock | Stock media |  |
| Sky News | Broadcast News |  |
| Slate | Digital Media |  |
| Snapchat | Messaging |  |
| Sony Music | Music |  |
| SoundCloud | Music |  |
| SSRN | Preprint server |  |
| Storyblocks | Stock media |  |
| TechCrunch | Technology |  |
| Tenet Healthcare | Health Care |  |
| The Asahi Shimbun | News |  |
| The Associated Press | Newswire |  |
| The Economist | Magazine |  |
| The Globe and Mail | News |  |
| The Hill | Politics |  |
| The Intercept | Investigative |  |
| The New York Times | News |  |
| The Sydney Morning Herald | News |  |
| The Telegraph | News |  |
| Threads | Social Network |  |
| TikTok | Video |  |
| Toronto Star | News |  |
| Toyota | Motor Vehicles |  |
| Tripadvisor | Web |  |
| Universal Music Group | Music |  |
| University of Cape Town | University |  |
| USA Today | News |  |
| Vimeo | Video |  |
| W.W. Grainger | Wholesale |  |
| Wattpad | Books |  |
| Weather | Weather |  |
| Messaging |  | |
| wikiHow | Dictionaries and Encyclopedias |  |
| WPP | Advertising |  |
| Yahoo | Web |  |
| Yahoo Search | Search engine |  |
| Yelp | Web |  |