Recorded Future / robots.txt
← back to recordedfuture.com · change detected 1mo ago (2026-06-26T23:05:56Z) · modified +1 −1
What changed
- Added Disallow: /cdn-cgi/ for *
Diff old (2026-06-20T14:27:25Z) → new (2026-06-26T23:05:56Z)
| @@ -5,7 +5,7 @@ | ||
| 5 | 5 | Disallow: /drafts/ |
| 6 | 6 | Disallow: /search |
| 7 | 7 | Disallow: /search/ |
| 8 | - | |
| 8 | + Disallow: /cdn-cgi/ | |
| 9 | 9 | |
| 10 | 10 | Sitemap: https://www.recordedfuture.com/sitemap-index.xml |
| 11 | 11 | Sitemap: https://www.recordedfuture.com/sitemap.xml |