ClaudeBot
Anthropic · LLM training crawler
102 of 1195 monitored sites (8.5%) block ClaudeBot by name, 3 restrict it.
ClaudeBot blocking over time share of monitored sites · weekly snapshot
Sites blocking
ClaudeBot
2026-06-23
2026-08-04
19 earlier weeks omitted (archive building) · 7 weekly snapshots with reliable coverage
Recent ClaudeBot events
- 2026-08-04 — Zscaler: Added rules for AI crawler ClaudeBot (Anthropic) diff
- 2026-08-04 — Commonwealth Bank: Added rules for AI crawler ClaudeBot (Anthropic) diff
- 2026-08-03 — Tanium: Added rules for AI crawler ClaudeBot (Anthropic) diff
- 2026-07-31 — Morgan Stanley: Added rules for AI crawler ClaudeBot (Anthropic) diff
- 2026-07-29 — Lithia Motors: Blocked ClaudeBot (Anthropic) entirely diff
- 2026-07-22 — Roblox: Unblocked ClaudeBot (Anthropic) - rules removed diff
- 2026-07-21 — Roblox: Blocked ClaudeBot (Anthropic) entirely diff
- 2026-07-21 — Roblox: Unblocked ClaudeBot (Anthropic) - rules removed diff
- 2026-07-20 — Waldo: Added rules for AI crawler ClaudeBot (Anthropic) diff
- 2026-07-20 — The Economist: Blocked ClaudeBot (Anthropic) entirely diff
- 2026-07-20 — Roblox: Blocked ClaudeBot (Anthropic) entirely diff
- 2026-07-18 — Ford Motor: Removed rules for AI crawler ClaudeBot (Anthropic) diff
- 2026-07-16 — Ford Motor: Added rules for AI crawler ClaudeBot (Anthropic) diff
- 2026-07-11 — Hulu: Removed Disallow: /start for ClaudeBot diff
- 2026-07-08 — Huntington Ingalls Industries: Added rules for AI crawler ClaudeBot (Anthropic) diff
- 2026-07-08 — Bloomberg: Added Allow: /company for ClaudeBot; Added Allow: /faq for ClaudeBot; Added Allow: /latam for ClaudeBot … and 2 more change(s) diff
- 2026-07-08 — Hulu: Added rules for AI crawler ClaudeBot (Anthropic) diff
- 2026-07-01 — Volvo Cars: Added Disallow: /*/build/* for ClaudeBot; Added Disallow: /*/order-request/* for ClaudeBot; Removed Disallow: /*/build/*?* for ClaudeBot … and 1 more change(s) diff
- 2026-07-01 — Fortra: Blocked ClaudeBot (Anthropic) entirely diff
- 2026-06-29 — Adidas: Added rules for AI crawler ClaudeBot (Anthropic) diff
- 2026-06-27 — Grupo Bimbo: Added rules for AI crawler ClaudeBot (Anthropic) diff
- 2026-06-27 — DataDome: Added rules for AI crawler ClaudeBot (Anthropic) diff
- 2026-06-24 — Ireland (Gov.ie): Blocked ClaudeBot (Anthropic) entirely diff
- 2026-06-17 — W.W. Grainger: Blocked ClaudeBot (Anthropic) entirely diff
- 2026-06-17 — Regeneron Pharmaceuticals: Added rules for AI crawler ClaudeBot (Anthropic) diff
- 2026-06-17 — Evonik: Added rules for AI crawler ClaudeBot (Anthropic) diff
- 2026-06-17 — Nikkei: Blocked ClaudeBot (Anthropic) entirely diff
Sites blocking ClaudeBot
| Site | Sector | Badge |
|---|---|---|
| AI21 Labs | LLM | |
| Al Jazeera | Broadcast News | |
| Amazon | Retailing | |
| ArcelorMittal | Steel | |
| Arrow Electronics | Technology | |
| Ars Technica | Technology | |
| Bandcamp | Music | |
| Baxter International | Health Care | |
| BBC | Broadcast News | |
| Behance | Graphics Multimedia and Web Design | |
| bioRxiv | Preprint server | |
| Bloomberg | News & Financial | |
| Burlington Stores | Retailing | |
| Business Insider | Business | |
| BuzzFeed | Digital Media | |
| Canva | Web | |
| CNN | Broadcast News | |
| Corriere della Sera | News | |
| Costa Rica (Presidencia) | Americas | |
| Daily Mail | News | |
| De Telegraaf | News | |
| Der Spiegel | News | |
| Die Zeit | News | |
| DOAJ | Open access directory | |
| eBay | Technology | |
| El Corte Ingles | Retail | |
| El País | News | |
| EPFL | University | |
| Expeditors International | Transportation | |
| Financial Times | News & Financial | |
| Forbes | Business | |
| Fortra | Cybersecurity | |
| Genius | Music | |
| Grok | LLM | |
| Guyana (Office of the President) | Americas | |
| HuffPost | Digital Media | |
| Iceland (Government.is) | Europe | |
| IGN | Web | |
| Social Network | ||
| Ireland (Gov.ie) | Europe | |
| Kimberly-Clark | Consumer Goods | |
| Le Figaro | News | |
| Le Monde | News | |
| Letterboxd | Arts and Entertainment | |
| Professional Network | ||
| Lithia Motors | Retailing | |
| Los Angeles Times | News | |
| Lufthansa Group | Airlines | |
| Medium | Publishing | |
| Mercado Libre | E-commerce | |
| Msn | Web | |
| NBC News | Broadcast News | |
| Newsweek | Magazine | |
| Nikkei | News & Financial | |
| Nintendo | Video Games | |
| Northrop Grumman | Aerospace & Defense | |
| NPR | Public Radio | |
| Pixiv | Art | |
| Politico | News | |
| Quora | Q&A | |
| Scribd | Public Records and Directories | |
| Sempra | Energy | |
| Shutterstock | Stock media | |
| Sky News | Broadcast News | |
| Slate | Digital Media | |
| SlideShare | Public Records and Directories | |
| Snapchat | Messaging | |
| Sony Music | Music | |
| SoundCloud | Music | |
| Storyblocks | Stock media | |
| TechCrunch | Technology | |
| Tenet Healthcare | Health Care | |
| The Asahi Shimbun | News | |
| The Associated Press | Newswire | |
| The Atlantic | Magazine | |
| The Economist | Magazine | |
| The Globe and Mail | News | |
| The Guardian | News | |
| The Hill | Politics | |
| The New York Times | News | |
| The New Yorker | Magazine | |
| The Sydney Morning Herald | News | |
| The Telegraph | News | |
| The Verge | Technology | |
| The Washington Post | News | |
| Threads | Social Network | |
| TikTok | Video | |
| Toronto Star | News | |
| Toyota | Motor Vehicles | |
| Tripadvisor | Web | |
| Tumblr | Social Network | |
| Uol | Web | |
| USA Today | News | |
| Vimeo | Video | |
| Vox | News | |
| W.W. Grainger | Wholesale | |
| Weather | Weather | |
| Messaging | ||
| wikiHow | Dictionaries and Encyclopedias | |
| Wired | Technology | |
| Yahoo Search | Search engine | |
| Yelp | Web |
Sites restricting ClaudeBot
Renault Group · Adidas · Vale