Indeed / robots.txt
← back to indeed.com · change detected 3d ago (2026-11-03T19:10:24Z) · modified +1 −1
What changed
- Formatting/comment-only change (no semantic difference)
Diff old (2026-10-07T21:56:40Z) → new (2026-11-03T19:10:24Z)
| @@ -427,7 +427,7 @@ | ||
| 427 | 427 | User-agent: CCBot |
| 428 | 428 | User-agent: anthropic-ai |
| 429 | 429 | User-agent: FacebookBot |
| 430 | - User-agent: AmazonBot | |
| 430 | + User-agent: Amazonbot | |
| 431 | 431 | User-agent: Applebot-Extended |
| 432 | 432 | User-agent: Bytespider |
| 433 | 433 | User-agent: Baiduspider |