Reuters / robots.txt
← back to reuters.com · change detected 12d ago (2026-07-23T20:15:59Z) · modified +2 −1
What changed
- Added Disallow: /account/subscribe/payment for AASA-Bot
- Added Disallow: /jp/ for AASA-Bot
- Removed Disallow: /account/subscribe/payment/ for AASA-Bot
- Added Disallow: /account/subscribe/payment for ADmantX
- Added Disallow: /jp/ for ADmantX
- Removed Disallow: /account/subscribe/payment/ for ADmantX
- Added Disallow: /account/subscribe/payment for AdsBot-Google
- Added Disallow: /jp/ for AdsBot-Google
- Removed Disallow: /account/subscribe/payment/ for AdsBot-Google
- Added Disallow: /account/subscribe/payment for AdsBot-Google-Mobile
- Added Disallow: /jp/ for AdsBot-Google-Mobile
- Removed Disallow: /account/subscribe/payment/ for AdsBot-Google-Mobile
- Added Disallow: /account/subscribe/payment for AmazonAdBot
- Added Disallow: /jp/ for AmazonAdBot
- Removed Disallow: /account/subscribe/payment/ for AmazonAdBot
- Added Disallow: /account/subscribe/payment for Amzn-User
- Added Disallow: /jp/ for Amzn-User
- Removed Disallow: /account/subscribe/payment/ for Amzn-User
- Added Disallow: /account/subscribe/payment for Applebot
- Added Disallow: /jp/ for Applebot
- Removed Disallow: /account/subscribe/payment/ for Applebot
- Added Disallow: /account/subscribe/payment for AppleNewsBot
- Added Disallow: /jp/ for AppleNewsBot
- Removed Disallow: /account/subscribe/payment/ for AppleNewsBot
- Added Disallow: /account/subscribe/payment for Bingbot
- Added Disallow: /jp/ for Bingbot
- Removed Disallow: /account/subscribe/payment/ for Bingbot
- Added Disallow: /account/subscribe/payment for BingPreview
- Added Disallow: /jp/ for BingPreview
- Removed Disallow: /account/subscribe/payment/ for BingPreview
- Added Disallow: /account/subscribe/payment for BrightEdge
- Added Disallow: /jp/ for BrightEdge
- Removed Disallow: /account/subscribe/payment/ for BrightEdge
- Added Disallow: /account/subscribe/payment for BrightEdgeOnCrawl
- Added Disallow: /jp/ for BrightEdgeOnCrawl
- Removed Disallow: /account/subscribe/payment/ for BrightEdgeOnCrawl
- Added Disallow: /account/subscribe/payment for CensysInspect
- Added Disallow: /jp/ for CensysInspect
- Removed Disallow: /account/subscribe/payment/ for CensysInspect
- 🤖 AIAdded Disallow: /account/subscribe/payment for ChatGPT-User
- 🤖 AIAdded Disallow: /jp/ for ChatGPT-User
- 🤖 AIRemoved Disallow: /account/subscribe/payment/ for ChatGPT-User
- Added Disallow: /account/subscribe/payment for Cision
- Added Disallow: /jp/ for Cision
- Removed Disallow: /account/subscribe/payment/ for Cision
- Added Disallow: /account/subscribe/payment for Clickagy
- Added Disallow: /jp/ for Clickagy
- Removed Disallow: /account/subscribe/payment/ for Clickagy
- Added Disallow: /account/subscribe/payment for Concert
- Added Disallow: /jp/ for Concert
- ... and 208 more change(s)
Diff old (2026-07-02T18:55:39Z) → new (2026-07-23T20:15:59Z)
| @@ -108,7 +108,8 @@ | ||
| 108 | 108 | Disallow: /pt/ |
| 109 | 109 | Disallow: /de/ |
| 110 | 110 | Disallow: /latam/ |
| 111 | - Disallow: /account/subscribe/payment/ | |
| 111 | + Disallow: /jp/ | |
| 112 | + Disallow: /account/subscribe/payment | |
| 112 | 113 | |
| 113 | 114 | # Block all other bots |
| 114 | 115 | User-agent: * |