NeuralCrawl

← All crawlers

ClaudeBot

Anthropic · LLM training crawler

105 of 1203 monitored sites (8.7%) block ClaudeBot by name, 2 restrict it.

ClaudeBot blocking over time share of monitored sites · weekly snapshot

Sites blocking ClaudeBot
2026-06-20 2026-11-07

5 earlier weeks omitted (archive building) · 21 weekly snapshots with reliable coverage

Recent ClaudeBot events

Sites blocking ClaudeBot

SiteSectorBadge
Advance Auto Parts Retailing badge
Airbnb Technology badge
Al Jazeera Broadcast News badge
AliExpress E-commerce badge
Amazon Retailing badge
ArcelorMittal Steel badge
Arrow Electronics Technology badge
Ars Technica Technology badge
Bandcamp Music badge
Bayer Pharmaceuticals badge
BBC Broadcast News badge
Behance Graphics Multimedia and Web Design badge
bioRxiv Preprint server badge
Bloomberg News & Financial badge
Business Insider Business badge
BuzzFeed Digital Media badge
Canva Web badge
Casey's General Stores Retailing badge
China Mobile Telecommunications badge
CNN Broadcast News badge
Corriere della Sera News badge
Costa Rica (Presidencia) Americas badge
Daily Mail News badge
De Telegraaf News badge
Der Spiegel News badge
Die Zeit News badge
eBay Technology badge
El País News badge
Europe PMC Research repository badge
Expeditors International Transportation badge
Facebook Social Network badge
Figma Community Graphics Multimedia and Web Design badge
Financial Times News & Financial badge
First American Financial Financials badge
Forbes Business badge
Genius Music badge
Grok LLM badge
Guyana (Office of the President) Americas badge
HuffPost Digital Media badge
Iceland (Government.is) Europe badge
IGN Web badge
Insight Enterprises Technology badge
Instagram Social Network badge
Ireland (Gov.ie) Europe badge
Kimberly-Clark Consumer Goods badge
Le Figaro News badge
Le Monde News badge
Letterboxd Arts and Entertainment badge
LinkedIn Professional Network badge
Lithia Motors Retailing badge
Los Angeles Times News badge
Lufthansa Group Airlines badge
Mastodon Social Network (Fediverse) badge
Medium Publishing badge
Mercado Libre E-commerce badge
Msn Web badge
NBC News Broadcast News badge
Newsweek Magazine badge
Nikkei News & Financial badge
Nintendo Video Games badge
Northrop Grumman Aerospace & Defense badge
NPR Public Radio badge
Pixiv Art badge
Politico News badge
Quora Q&A badge
Reliance Steel & Aluminum Materials badge
Scribd Public Records and Directories badge
Shutterstock Stock media badge
Sky News Broadcast News badge
Slate Digital Media badge
SlideShare Public Records and Directories badge
Snapchat Messaging badge
Sony Music Music badge
SoundCloud Music badge
Storyblocks Stock media badge
TechCrunch Technology badge
The Asahi Shimbun News badge
The Associated Press Newswire badge
The Atlantic Magazine badge
The Economist Magazine badge
The Globe and Mail News badge
The Guardian News badge
The Hill Politics badge
The New York Times News badge
The New Yorker Magazine badge
The Sydney Morning Herald News badge
The Telegraph News badge
The Verge Technology badge
The Washington Post News badge
Threads Social Network badge
Tidal Music badge
TikTok Video badge
Toronto Star News badge
Tripadvisor Web badge
Tumblr Social Network badge
Uol Web badge
USA Today News badge
Vimeo Video badge
Vox News badge
W.W. Grainger Wholesale badge
WhatsApp Messaging badge
wikiHow Dictionaries and Encyclopedias badge
Wired Technology badge
Yahoo Search Search engine badge
Yelp Web badge

Sites restricting ClaudeBot

Adidas · Vale