BBC / robots.txt
← back to bbc.com · change detected 2mo ago (2026-08-24T13:15:37Z) · modified +17 −13
What changed
- Added sitemap https://www.bbc.com/sitemaps/https-index-com-mundo-archive.xml
- Added sitemap https://www.bbc.com/sitemaps/https-index-com-mundo-archive_video.xml
- Added sitemap https://www.bbc.com/sitemaps/https-index-com-mundo-news.xml
- Added sitemap https://www.bbc.com/sitemaps/https-index-com-mundo-video.xml
Diff old (2026-07-29T16:38:54Z) → new (2026-08-24T13:15:37Z)
| @@ -1,5 +1,5 @@ | ||
| 1 | 1 | |
| 2 | - # version: a294511aea2df10f410588a60a9157e46ab994a2 | |
| 2 | + # version: 958ed1a58c8ce418427283859a5538a5ce0eb62d | |
| 3 | 3 | # The BBC's Terms of Use: https://www.bbc.co.uk/terms |
| 4 | 4 | # - Explain the rules for using our services |
| 5 | 5 | # - Tell you what you can do with our content |
| @@ -21,16 +21,12 @@ | ||
| 21 | 21 | # HTTPS www.bbc.com |
| 22 | 22 | |
| 23 | 23 | User-agent: * |
| 24 | - Sitemap: https://www.bbc.com/sitemaps/https-index-com-archive.xml | |
| 25 | - Sitemap: https://www.bbc.com/sitemaps/https-index-com-news.xml | |
| 26 | - Sitemap: https://www.bbc.com/sitemaps/https-index-com-archive_video.xml | |
| 27 | - Sitemap: https://www.bbc.com/sitemaps/https-index-com-video.xml | |
| 28 | - Sitemap: https://www.bbc.com/sitemaps/sitemap-com-ws-topics.xml | |
| 29 | - Sitemap: https://www.bbc.com/sitemaps/sitemap-com-ws-topics.xml | |
| 30 | - Sitemap: https://www.bbc.com/sitemaps/world-service-homepages.xml | |
| 31 | - Sitemap: https://www.bbc.com/sport/sitemap.xml | |
| 32 | 24 | Sitemap: https://www.bbc.com/afrique/sitemap.xml |
| 33 | 25 | Sitemap: https://www.bbc.com/arabic/sitemap.xml |
| 26 | + Sitemap: https://www.bbc.com/bbcx/audio_archive_sitemap.xml | |
| 27 | + Sitemap: https://www.bbc.com/bbcx/content_index_sitemap.xml | |
| 28 | + Sitemap: https://www.bbc.com/bbcx/index_sitemap.xml | |
| 29 | + Sitemap: https://www.bbc.com/bbcx/video_documentaries_sitemap.xml | |
| 34 | 30 | Sitemap: https://www.bbc.com/bengali/sitemap.xml |
| 35 | 31 | Sitemap: https://www.bbc.com/burmese/sitemap.xml |
| 36 | 32 | Sitemap: https://www.bbc.com/gahuza/sitemap.xml |
| @@ -42,6 +38,18 @@ | ||
| 42 | 38 | Sitemap: https://www.bbc.com/persian/sitemap.xml |
| 43 | 39 | Sitemap: https://www.bbc.com/portuguese/sitemap.xml |
| 44 | 40 | Sitemap: https://www.bbc.com/russian/sitemap.xml |
| 41 | + Sitemap: https://www.bbc.com/sitemaps/https-index-com-archive_video.xml | |
| 42 | + Sitemap: https://www.bbc.com/sitemaps/https-index-com-archive.xml | |
| 43 | + Sitemap: https://www.bbc.com/sitemaps/https-index-com-mundo-archive_video.xml | |
| 44 | + Sitemap: https://www.bbc.com/sitemaps/https-index-com-mundo-archive.xml | |
| 45 | + Sitemap: https://www.bbc.com/sitemaps/https-index-com-mundo-news.xml | |
| 46 | + Sitemap: https://www.bbc.com/sitemaps/https-index-com-mundo-video.xml | |
| 47 | + Sitemap: https://www.bbc.com/sitemaps/https-index-com-news.xml | |
| 48 | + Sitemap: https://www.bbc.com/sitemaps/https-index-com-video.xml | |
| 49 | + Sitemap: https://www.bbc.com/sitemaps/sitemap-com-ws-topics.xml | |
| 50 | + Sitemap: https://www.bbc.com/sitemaps/sitemap-com-ws-topics.xml | |
| 51 | + Sitemap: https://www.bbc.com/sitemaps/world-service-homepages.xml | |
| 52 | + Sitemap: https://www.bbc.com/sport/sitemap.xml | |
| 45 | 53 | Sitemap: https://www.bbc.com/swahili/sitemap.xml |
| 46 | 54 | Sitemap: https://www.bbc.com/tajik/sitemap.xml |
| 47 | 55 | Sitemap: https://www.bbc.com/turkce/sitemap.xml |
| @@ -52,10 +60,6 @@ | ||
| 52 | 60 | Sitemap: https://www.bbc.com/vietnamese/sitemap.xml |
| 53 | 61 | Sitemap: https://www.bbc.com/zhongwen/simp/sitemap.xml |
| 54 | 62 | Sitemap: https://www.bbc.com/zhongwen/trad/sitemap.xml |
| 55 | - Sitemap: https://www.bbc.com/bbcx/index_sitemap.xml | |
| 56 | - Sitemap: https://www.bbc.com/bbcx/audio_archive_sitemap.xml | |
| 57 | - Sitemap: https://www.bbc.com/bbcx/video_documentaries_sitemap.xml | |
| 58 | - Sitemap: https://www.bbc.com/bbcx/content_index_sitemap.xml | |
| 59 | 63 | |
| 60 | 64 | Disallow: /asset/ |
| 61 | 65 | Disallow: /backstage/bbc-login-help/ |