Time / robots.txt
← back to time.com · change detected 1mo ago (2026-09-22T10:23:37Z) · modified +3 −0
What changed
- Added rules for user-agent ‘BomboraBot’
Diff old (2026-07-29T10:28:28Z) → new (2026-09-22T10:23:37Z)
| @@ -83,6 +83,9 @@ | ||
| 83 | 83 | Disallow: /uncategorized |
| 84 | 84 | Disallow: /time_cover_hub |
| 85 | 85 | |
| 86 | + User-Agent: BomboraBot | |
| 87 | + Allow: / | |
| 88 | + | |
| 86 | 89 | Sitemap: https://time.com/sitemap.xml |
| 87 | 90 | Sitemap: https://time.com/news-sitemap.xml |
| 88 | 91 | Sitemap: https://time.com/branded-content-sitemap.xml |