Slate / robots.txt
← back to slate.com · change detected 24d ago (2026-10-13T23:51:59Z) · modified +1 −0
What changed
- Blocked user-agent ‘ImageBot’ entirely
Diff old (2026-09-29T18:55:02Z) → new (2026-10-13T23:51:59Z)
| @@ -56,6 +56,7 @@ | ||
| 56 | 56 | User-agent: HTTrack 3.0 |
| 57 | 57 | User-agent: Hunyuan |
| 58 | 58 | User-agent: ICC-Crawler |
| 59 | + User-agent: ImageBot | |
| 59 | 60 | User-agent: imageSpider |
| 60 | 61 | User-agent: IndeedJobBot |
| 61 | 62 | User-agent: Kangaroo Bot |