NeuralCrawl

ChatGPT / robots.txt

← back to chatgpt.com · change detected 1mo ago (2026-07-07T02:22:00Z) · modified +6 −0

What changed

Diff old (2026-06-26T13:23:15Z)new (2026-07-07T02:22:00Z)

@@ -8,6 +8,12 @@
88 
99  User-agent: Google-Extended
1010  Disallow: /
11+
12+ # Prevent shared code blocks and GPTs from being used as Google Ads destinations
13+ User-agent: AdsBot-Google
14+ User-agent: AdsBot-Google-Mobile
15+ Disallow: /s/cb_
16+ Disallow: /g/
1117 
1218  User-agent: anthropic-ai
1319  Disallow: /