NeuralCrawl

ChatGPT / robots.txt

← back to chatgpt.com · change detected 2mo ago (2026-08-15T22:38:38Z) · modified +3 −2

What changed

Diff old (2026-08-07T01:28:26Z) → new (2026-08-15T22:38:38Z)

@@ -9,10 +9,10 @@
99  User-agent: Google-Extended
1010  Disallow: /
1111 
12- # Prevent shared code blocks and GPTs from being used as Google Ads destinations
12+ # Prevent shared pages and GPTs from being used as Google Ads destinations
1313  User-agent: AdsBot-Google
1414  User-agent: AdsBot-Google-Mobile
15- Disallow: /s/cb_
15+ Disallow: /s/
1616  Disallow: /g/
1717 
1818  User-agent: anthropic-ai
@@ -54,6 +54,7 @@
5454  Allow: /g/
5555  Allow: /s/
5656  Allow: /gg/v/
57+ Allow: /m/
5758  Allow: /share/
5859  Allow: /canvas/shared/
5960  Allow: /*/images