BBC / robots.txt
← back to bbc.com · change detected 5d ago (2026-11-02T12:53:58Z) · modified +7 −1
What changed
- 🤖 AIBlocked Claude-SearchBot (Anthropic) entirely
- 🤖 AIBlocked DuckAssistBot (DuckDuckGo) entirely
Diff old (2026-10-08T16:07:06Z) → new (2026-11-02T12:53:58Z)
| @@ -1,5 +1,5 @@ | ||
| 1 | 1 | |
| 2 | - # version: 20b91abf30af3b3b076745396ba368978384f4d7 | |
| 2 | + # version: 2323e66fcb22a9568be0b7ab535fafcd2bf666ad | |
| 3 | 3 | # The BBC's Terms of Use: https://www.bbc.co.uk/terms |
| 4 | 4 | # - Explain the rules for using our services |
| 5 | 5 | # - Tell you what you can do with our content |
| @@ -235,3 +235,9 @@ | ||
| 235 | 235 | |
| 236 | 236 | User-agent: AhrefsBot |
| 237 | 237 | Disallow: / |
| 238 | + | |
| 239 | + User-agent: Claude-SearchBot | |
| 240 | + Disallow: / | |
| 241 | + | |
| 242 | + User-agent: DuckAssistBot | |
| 243 | + Disallow: / |