Reuters / robots.txt
← back to reuters.com · change detected 21d ago (2026-08-28T14:35:53Z) · modified +3 −0
What changed
- 🤖 AIBlocked Applebot-Extended (Apple) entirely
Diff old (2026-08-25T19:41:43Z) → new (2026-08-28T14:35:53Z)
| @@ -111,6 +111,9 @@ | ||
| 111 | 111 | Disallow: /jp/ |
| 112 | 112 | Disallow: /account/subscribe/payment |
| 113 | 113 | |
| 114 | + User-agent: Applebot-Extended | |
| 115 | + Disallow: / | |
| 116 | + | |
| 114 | 117 | # Block all other bots |
| 115 | 118 | User-agent: * |
| 116 | 119 | Allow: /plus/ |