GPTBot

Recent GPTBot events

• 2026-09-18 — Commonwealth Bank: Added Allow: /digital/home-loans/borrowing-power-calculator for GPTBot; Added Allow: /etc/designs/commbank/favicon.ico for GPTBot diff
• 2026-09-17 — GoDaddy: Added Allow: */domain-auctions/ for GPTBot; Added Allow: */domainsearch/ for GPTBot; Added Disallow: */domain-auctions/api/ for GPTBot … and 2 more change(s) diff
• 2026-09-17 — Best Buy: Removed Disallow: *?cp=*&id=*&st=* for GPTBot; Removed Disallow: *?id*_facet*&st=* for GPTBot; Removed Disallow: *?id*_facet*_facet*&st=* for GPTBot diff
• 2026-09-16 — GoDaddy: Added rules for AI crawler GPTBot (OpenAI) diff
• 2026-09-16 — Weather: Unblocked GPTBot (OpenAI) - rules removed diff
• 2026-09-16 — Sony Music: Unblocked GPTBot (OpenAI) - rules removed diff
• 2026-09-16 — Expeditors International: Unblocked GPTBot (OpenAI) - rules removed diff
• 2026-09-16 — Tenet Healthcare: Unblocked GPTBot (OpenAI) - rules removed diff
• 2026-09-16 — Guyana (Office of the President): Unblocked GPTBot (OpenAI) - rules removed diff
• 2026-09-16 — Costa Rica (Presidencia): Unblocked GPTBot (OpenAI) - rules removed diff
• 2026-09-16 — EPFL: Unblocked GPTBot (OpenAI) - rules removed diff
• 2026-09-16 — AI21 Labs: Unblocked GPTBot (OpenAI) - rules removed diff
• 2026-09-16 — Iceland (Government.is): Unblocked GPTBot (OpenAI) - rules removed diff
• 2026-09-15 — xAI: Removed rules for AI crawler GPTBot (OpenAI) diff
• 2026-09-12 — GitHub: Added rules for AI crawler GPTBot (OpenAI) diff
• 2026-09-11 — Zscaler: Added Disallow: /8199ac63-be6c-4cba-9bd9-45500a02d64f.txt for GPTBot; Removed Disallow: /indexNowKey.txt for GPTBot diff
• 2026-09-11 — Canva: Added Allow: /*/ai-connector/ for GPTBot; Added Allow: /ai-connector/ for GPTBot; Added Allow: /developers/ for GPTBot diff
• 2026-09-09 — SAP: Added Disallow: /fetch for GPTBot; Added Disallow: /proxy for GPTBot; Added Disallow: /sharedlibs/ for GPTBot diff
• 2026-09-09 — Commonwealth Bank: Removed Disallow: /personal/eform/ for GPTBot diff
• 2026-09-09 — Moz: Added rules for AI crawler GPTBot (OpenAI) diff
• 2026-09-08 — Moz: Removed rules for AI crawler GPTBot (OpenAI) diff
• 2026-09-08 — LG Corp: Removed rules for AI crawler GPTBot (OpenAI) diff
• 2026-09-07 — Intel: Added rules for AI crawler GPTBot (OpenAI) diff
• 2026-09-07 — Europe PMC: Removed Disallow: /*/*jsessionid* for GPTBot; Removed Disallow: /*?europe_pmc_extredirect=* for GPTBot; Removed Disallow: /*?wicket:interface* for GPTBot … and 5 more change(s) diff
• 2026-09-07 — Europe PMC: Added Disallow: /*/*jsessionid* for GPTBot; Added Disallow: /*?europe_pmc_extredirect=* for GPTBot; Added Disallow: /*?wicket:interface* for GPTBot … and 5 more change(s) diff
• 2026-09-07 — DBLP: Blocked GPTBot (OpenAI) entirely diff
• 2026-09-05 — USA Today: Added Allow: /branded-story/ for GPTBot; Removed Allow: /story/sponsor-story/address-usa/2026/08/21/should-sellers-accept-the-first-offer-what-to-consider-beyond-price/91390104007/ for GPTBot; Removed Allow: /story/sponsor-story/real-estate-ausa/2026/08/21/buy-now-or-wait-until-fall-tips-for-homebuyers-in-2026/91389661007/ for GPTBot diff
• 2026-09-05 — USA Today: Added Allow: /story/sponsor-story/address-usa/2026/08/21/should-sellers-accept-the-first-offer-what-to-consider-beyond-price/91390104007/ for GPTBot; Added Allow: /story/sponsor-story/real-estate-ausa/2026/08/21/buy-now-or-wait-until-fall-tips-for-homebuyers-in-2026/91389661007/ for GPTBot; Removed Allow: /branded-story/ for GPTBot diff
• 2026-09-04 — USA Today: Added Allow: /branded-story/ for GPTBot; Removed Allow: /story/sponsor-story/address-usa/2026/08/21/should-sellers-accept-the-first-offer-what-to-consider-beyond-price/91390104007/ for GPTBot; Removed Allow: /story/sponsor-story/real-estate-ausa/2026/08/21/buy-now-or-wait-until-fall-tips-for-homebuyers-in-2026/91389661007/ for GPTBot diff
• 2026-09-04 — Canva: Added Allow: /*/design-school/ for GPTBot; Added Allow: /design-school/ for GPTBot diff

Sites blocking GPTBot

Site	Sector	Badge
ABC News	Broadcast News
Academia.edu	Research network
Adobe Stock	Stock media
Al Jazeera	Broadcast News
Alibaba Group	E-commerce
Amazon	Retailing
ArcelorMittal	Steel
Archive of Our Own	Books
Arrow Electronics	Technology
Bandcamp	Music
Baxter International	Health Care
BBC	Broadcast News
Behance	Graphics Multimedia and Web Design
bioRxiv	Preprint server
Bloomberg	News & Financial
Burlington Stores	Retailing
BuzzFeed	Digital Media
Canva	Web
Casey's General Stores	Retailing
CBS News	Broadcast News
China Mobile	Telecommunications
Claude	LLM
CNN	Broadcast News
Corriere della Sera	News
Daily Mail	News
DBLP	CS bibliography
De Telegraaf	News
Der Spiegel	News
Die Zeit	News
Disney	Web
eBay	Technology
ESPN	Web
Europe PMC	Research repository
Figma Community	Graphics Multimedia and Web Design
Forbes	Business
Genius	Music
Globo	Web
Goodreads	Books
Grok	LLM
HuffPost	Digital Media
IGN	Web
Instagram	Social Network
Ireland (Gov.ie)	Europe
Khan Academy	Education
Kimberly-Clark	Consumer Goods
Le Figaro	News
Letterboxd	Arts and Entertainment
LinkedIn	Professional Network
Lithia Motors	Retailing
Los Angeles Times	News
Lufthansa Group	Airlines
Mastodon	Social Network (Fediverse)
Medium	Publishing
Mercado Libre	E-commerce
Midjourney	LLM
Msn	Web
NBC News	Broadcast News
Newsweek	Magazine
Nextdoor	Social Network
Nikkei	News & Financial
Nintendo	Video Games
Northrop Grumman	Aerospace & Defense
NPR	Public Radio
PG&E	Energy
Pixiv	Art
Politico	News
Pond5	Stock media
Prudential Financial	Financials
Quora	Q&A
Reliance Steel & Aluminum	Materials
Sempra	Energy
Shutterstock	Stock media
Sky News	Broadcast News
Slate	Digital Media
Snapchat	Messaging
SoundCloud	Music
SSRN	Preprint server
Storyblocks	Stock media
TechCrunch	Technology
The Asahi Shimbun	News
The Associated Press	Newswire
The Economist	Magazine
The Globe and Mail	News
The Hill	Politics
The Intercept	Investigative
The New York Times	News
The Sydney Morning Herald	News
The Telegraph	News
Threads	Social Network
Tidal	Music
TikTok	Video
Toronto Star	News
Toyota	Motor Vehicles
Tripadvisor	Web
Universal Music Group	Music
University of Cape Town	University
USA Today	News
Vimeo	Video
W.W. Grainger	Wholesale
Wattpad	Books
WhatsApp	Messaging
wikiHow	Dictionaries and Encyclopedias
WPP	Advertising
Yahoo	Web
Yahoo Search	Search engine
Yelp	Web

Sites restricting GPTBot

S&P Global · Novartis · Kuehne+Nagel