Reuters / robots.txt
← back to reuters.com · change detected 9d ago (2026-10-28T23:10:43Z) · modified +0 −1
What changed
- Removed all rules for user-agent ‘Mantisbot’
Diff old (2026-09-23T22:52:11Z) → new (2026-10-28T23:10:43Z)
| @@ -51,7 +51,6 @@ | ||
| 51 | 51 | User-agent: leiki |
| 52 | 52 | User-agent: LinkedInBot |
| 53 | 53 | User-agent: LinkTiger |
| 54 | - User-agent: Mantisbot | |
| 55 | 54 | User-agent: Mediapartners-Google |
| 56 | 55 | User-agent: meta-externalads |
| 57 | 56 | User-agent: meta-webindexer |