Claude / robots.txt
← back to claude.ai · change detected 5d ago (2026-07-30T16:59:37Z) · modified +1 −1
What changed
- 🤖 AIBlocked Google-Extended (Google) entirely
- Removed Disallow: /share/* for *
Diff old (2026-06-26T13:23:15Z) → new (2026-07-30T16:59:37Z)
| @@ -6,12 +6,12 @@ | ||
| 6 | 6 | User-Agent: GPTBot |
| 7 | 7 | User-Agent: OAI-SearchBot |
| 8 | 8 | User-Agent: ChatGPT-User |
| 9 | + User-Agent: Google-Extended | |
| 9 | 10 | Disallow: / |
| 10 | 11 | |
| 11 | 12 | User-Agent: * |
| 12 | 13 | Disallow: /new?* |
| 13 | 14 | Disallow: /chat/* |
| 14 | - Disallow: /share/* | |
| 15 | 15 | Disallow: /join/* |
| 16 | 16 | Disallow: /magic-link* |
| 17 | 17 | Disallow: /api/* |