Claude-Web
Anthropic · Legacy crawler token
60 of 1203 monitored sites (5.0%) block Claude-Web by name.
Claude-Web blocking over time share of monitored sites · weekly snapshot
Sites blocking
Claude-Web
2026-06-22
2026-11-09
5 earlier weeks omitted (archive building) · 21 weekly snapshots with reliable coverage
Recent Claude-Web events
- 2026-11-05 — SoundCloud: Blocked Claude-Web (Anthropic) entirely diff
- 2026-11-05 — First American Financial: Blocked Claude-Web (Anthropic) entirely diff
- 2026-11-05 — Best Buy: Removed Disallow: /[1.1] for Claude-Web diff
- 2026-10-31 — Burlington Stores: Unblocked Claude-Web (Anthropic) - rules removed diff
- 2026-10-30 — The Asahi Shimbun: Added Allow: /corporate/ for Claude-Web diff
- 2026-10-27 — Europe PMC: Blocked Claude-Web (Anthropic) entirely diff
- 2026-10-24 — Guyana (Office of the President): Blocked Claude-Web (Anthropic) entirely diff
- 2026-10-22 — Costa Rica (Presidencia): Blocked Claude-Web (Anthropic) entirely diff
- 2026-10-22 — Sony Music: Blocked Claude-Web (Anthropic) entirely diff
- 2026-10-20 — Daily Mail: Added Allow: /llms.txt for Claude-Web diff
- 2026-10-20 — Cencora: Added rules for AI crawler Claude-Web (Anthropic) diff
- 2026-10-19 — Iceland (Government.is): Blocked Claude-Web (Anthropic) entirely diff
- 2026-10-18 — Lithia Motors: Blocked Claude-Web (Anthropic) entirely diff
- 2026-10-18 — Expeditors International: Blocked Claude-Web (Anthropic) entirely diff
- 2026-10-16 — EPFL: Unblocked Claude-Web (Anthropic) - rules removed diff
- 2026-10-12 — EPFL: Blocked Claude-Web (Anthropic) entirely diff
- 2026-10-12 — DBLP: Unblocked Claude-Web (Anthropic) - rules removed diff
- 2026-10-08 — Canva: Added Allow: /tr_tr/grafik/ for Claude-Web; Added Allow: /tr_tr/ozellikler/ for Claude-Web; Added Allow: /tr_tr/sema/ for Claude-Web … and 1 more change(s) diff
- 2026-10-07 — NetApp: Added rules for AI crawler Claude-Web (Anthropic) diff
- 2026-10-06 — SoundCloud: Unblocked Claude-Web (Anthropic) - rules removed diff
- 2026-10-06 — SoundCloud: Blocked Claude-Web (Anthropic) entirely diff
- 2026-10-05 — SoundCloud: Unblocked Claude-Web (Anthropic) - rules removed diff
- 2026-10-05 — SoundCloud: Blocked Claude-Web (Anthropic) entirely diff
- 2026-10-01 — Check Point: Added rules for AI crawler Claude-Web (Anthropic) diff
- 2026-09-30 — SoundCloud: Unblocked Claude-Web (Anthropic) - rules removed diff
- 2026-09-30 — EDF: Added rules for AI crawler Claude-Web (Anthropic) diff
- 2026-09-30 — SoundCloud: Blocked Claude-Web (Anthropic) entirely diff
- 2026-09-29 — Der Spiegel: Added Allow: /ausland/ for Claude-Web; Added Allow: /familie/ for Claude-Web; Added Allow: /gesundheit/ for Claude-Web … and 5 more change(s) diff
- 2026-09-23 — Daily Mail: Removed Allow: /buyline/ for Claude-Web diff
- 2026-09-16 — Weather: Unblocked Claude-Web (Anthropic) - rules removed diff
Sites blocking Claude-Web
| Site | Sector | Badge |
|---|---|---|
| Adobe Stock | Stock media | |
| Al Jazeera | Broadcast News | |
| Amazon | Retailing | |
| Ars Technica | Technology | |
| BBC | Broadcast News | |
| Behance | Graphics Multimedia and Web Design | |
| Bloomberg | News & Financial | |
| BuzzFeed | Digital Media | |
| Canva | Web | |
| ChatGPT | LLM | |
| CNN | Broadcast News | |
| Corriere della Sera | News | |
| Costa Rica (Presidencia) | Americas | |
| Daily Mail | News | |
| De Telegraaf | News | |
| Der Spiegel | News | |
| Europe PMC | Research repository | |
| Expeditors International | Transportation | |
| Financial Times | News & Financial | |
| First American Financial | Financials | |
| Guyana (Office of the President) | Americas | |
| HuffPost | Digital Media | |
| Iceland (Government.is) | Europe | |
| IGN | Web | |
| Le Figaro | News | |
| Le Monde | News | |
| Professional Network | ||
| Lithia Motors | Retailing | |
| Msn | Web | |
| NBC News | Broadcast News | |
| Newsweek | Magazine | |
| Nikkei | News & Financial | |
| Nintendo | Video Games | |
| NPR | Public Radio | |
| Politico | News | |
| Scribd | Public Records and Directories | |
| SlideShare | Public Records and Directories | |
| Snapchat | Messaging | |
| Sony Music | Music | |
| SoundCloud | Music | |
| TechCrunch | Technology | |
| The Asahi Shimbun | News | |
| The Associated Press | Newswire | |
| The Atlantic | Magazine | |
| The Economist | Magazine | |
| The Globe and Mail | News | |
| The Hill | Politics | |
| The New York Times | News | |
| The Sydney Morning Herald | News | |
| The Telegraph | News | |
| The Verge | Technology | |
| The Washington Post | News | |
| Toronto Star | News | |
| Uol | Web | |
| USA Today | News | |
| Vimeo | Video | |
| Vox | News | |
| wikiHow | Dictionaries and Encyclopedias | |
| Yahoo Search | Search engine | |
| Yelp | Web |