Bytespider

Recent Bytespider events

• 2026-08-04 — Commonwealth Bank: Added rules for AI crawler Bytespider (ByteDance) diff
• 2026-08-04 — Weibo: Blocked Bytespider (ByteDance) entirely diff
• 2026-07-29 — Lithia Motors: Blocked Bytespider (ByteDance) entirely diff
• 2026-07-27 — NBC News: Blocked user-agent ‘ByteSpider Desktop’ entirely diff
• 2026-07-27 — Le Figaro: Unblocked Bytespider (ByteDance) - rules removed diff
• 2026-07-22 — Roblox: Unblocked Bytespider (ByteDance) - rules removed diff
• 2026-07-21 — SoundCloud: Unblocked Bytespider (ByteDance) - rules removed diff
• 2026-07-21 — Roblox: Blocked Bytespider (ByteDance) entirely diff
• 2026-07-21 — SoundCloud: Blocked Bytespider (ByteDance) entirely diff
• 2026-07-21 — Roblox: Unblocked Bytespider (ByteDance) - rules removed diff
• 2026-07-20 — Roblox: Blocked Bytespider (ByteDance) entirely diff
• 2026-07-20 — Weibo: Unblocked Bytespider (ByteDance) - rules removed diff
• 2026-07-20 — Weibo: Blocked Bytespider (ByteDance) entirely diff
• 2026-07-08 — Trend Micro: Removed Allow: *.css$ for Bytespider; Removed Allow: *.js$ for Bytespider; Removed Disallow: /*/business/parsing-pages/ for Bytespider … and 5 more change(s) diff
• 2026-07-08 — Hulu: Added rules for AI crawler Bytespider (ByteDance) diff
• 2026-07-07 — SoundCloud: Unblocked Bytespider (ByteDance) - rules removed diff
• 2026-07-06 — SoundCloud: Blocked Bytespider (ByteDance) entirely diff
• 2026-07-02 — Kuehne+Nagel: Added rules for AI crawler Bytespider (ByteDance) diff
• 2026-07-01 — Volvo Cars: Added Disallow: /*/build/* for Bytespider; Added Disallow: /*/order-request/* for Bytespider; Removed Disallow: /*/build/*?* for Bytespider … and 1 more change(s) diff
• 2026-07-01 — Fortra: Added rules for AI crawler Bytespider (ByteDance) diff
• 2026-06-29 — Corriere della Sera: Blocked Bytespider (ByteDance) entirely diff
• 2026-06-28 — Corriere della Sera: Unblocked Bytespider (ByteDance) - rules removed diff
• 2026-06-28 — Corriere della Sera: Blocked Bytespider (ByteDance) entirely diff
• 2026-06-27 — Corriere della Sera: Unblocked Bytespider (ByteDance) - rules removed diff
• 2026-06-27 — Corriere della Sera: Blocked Bytespider (ByteDance) entirely diff
• 2026-06-27 — Corriere della Sera: Unblocked Bytespider (ByteDance) - rules removed diff
• 2026-06-26 — SoundCloud: Unblocked Bytespider (ByteDance) - rules removed diff
• 2026-06-26 — Corriere della Sera: Blocked Bytespider (ByteDance) entirely diff
• 2026-06-25 — SoundCloud: Blocked Bytespider (ByteDance) entirely diff
• 2026-06-17 — W.W. Grainger: Blocked Bytespider (ByteDance) entirely diff

Sites blocking Bytespider

Site	Sector	Badge
ABC News	Broadcast News
AI21 Labs	LLM
Airbus	Aerospace & Defense
Al Jazeera	Broadcast News
Amazon	Retailing
ArcelorMittal	Steel
Arkose Labs	Cybersecurity
Ars Technica	Technology
Axios	News
Bandcamp	Music
Baxter International	Health Care
BBC	Broadcast News
Behance	Graphics Multimedia and Web Design
Bild	News
bioRxiv	Preprint server
Bloomberg	News & Financial
Burlington Stores	Retailing
Business Insider	Business
BuzzFeed	Digital Media
Canva	Web
ChatGPT	LLM
CNN	Broadcast News
Corriere della Sera	News
Costa Rica (Presidencia)	Americas
Daily Mail	News
De Telegraaf	News
Der Spiegel	News
Die Zeit	News
DOAJ	Open access directory
eBay	Technology
El Corte Ingles	Retail
El País	News
Electronic Arts	Technology
EPFL	University
ESPN	Web
Expeditors International	Transportation
Financial Times	News & Financial
Forbes	Business
Genius	Music
Guyana (Office of the President)	Americas
HuffPost	Digital Media
Iceland (Government.is)	Europe
IGN	Web
Insight Enterprises	Technology
Kimberly-Clark	Consumer Goods
Le Monde	News
Letterboxd	Arts and Entertainment
LinkedIn	Professional Network
Lithia Motors	Retailing
Los Angeles Times	News
Lufthansa Group	Airlines
Medium	Publishing
Midjourney	LLM
Msn	Web
NBC News	Broadcast News
Newsweek	Magazine
Nikkei	News & Financial
Nintendo	Video Games
NPR	Public Radio
Politico	News
Quora	Q&A
Scribd	Public Records and Directories
Sempra	Energy
Sky News	Broadcast News
Slate	Digital Media
SlideShare	Public Records and Directories
Snapchat	Messaging
Sony Music	Music
Storyblocks	Stock media
TechCrunch	Technology
Telstra	Telecommunications
Tenet Healthcare	Health Care
The Asahi Shimbun	News
The Atlantic	Magazine
The Economist	Magazine
The Globe and Mail	News
The Guardian	News
The Hill	Politics
The New York Times	News
The New Yorker	Magazine
The Sydney Morning Herald	News
The Telegraph	News
The Verge	Technology
The Washington Post	News
TikTok	Video
Toronto Star	News
Toyota	Motor Vehicles
Tripadvisor	Web
University of Cape Town	University
Uol	Web
USA Today	News
Vimeo	Video
Vox	News
W.W. Grainger	Wholesale
Weather	Weather
Weibo	Social Network
wikiHow	Dictionaries and Encyclopedias
Wired	Technology
Yahoo Search	Search engine