Forbes / robots.txt
← back to forbes.com · change detected 16d ago (2026-07-21T01:14:44Z) · modified +2 −0
What changed
- Formatting/comment-only change (no semantic difference)
Diff old (2026-06-20T01:10:30Z) → new (2026-07-21T01:14:44Z)
| @@ -327,12 +327,14 @@ | ||
| 327 | 327 | Disallow: / |
| 328 | 328 | |
| 329 | 329 | User-agent: CCBot |
| 330 | + User-agent: CCbot | |
| 330 | 331 | Disallow: / |
| 331 | 332 | |
| 332 | 333 | User-agent: ClaudeBot |
| 333 | 334 | Disallow: / |
| 334 | 335 | |
| 335 | 336 | User-agent: cohere-ai |
| 337 | + User-agent: Cohere-AI | |
| 336 | 338 | Disallow: / |
| 337 | 339 | |
| 338 | 340 | User-agent: Diffbot |