Daily Mail / robots.txt
← back to dailymail.co.uk · change detected 2mo ago (2026-08-19T17:42:34Z) · modified +8 −17
What changed
- Added sitemap https://www.dailymail.com/video-new-sitemap.xml
- Removed sitemap https://www.dailymail.com/sitemap-authors.xml
- Removed sitemap https://www.dailymail.com/sitemap-channels.xml
- Removed sitemap https://www.dailymail.com/sitemap-columnist.xml
- Removed sitemap https://www.dailymail.com/sitemap-facts-year~2021.xml
- Removed sitemap https://www.dailymail.com/sitemap-facts-year~2022.xml
- Removed sitemap https://www.dailymail.com/sitemap-facts-year~2023.xml
- Removed sitemap https://www.dailymail.com/sitemap-facts-year~2024.xml
- Removed sitemap https://www.dailymail.com/sitemap-facts-year~2025.xml
- Removed sitemap https://www.dailymail.com/sitemap-facts-year~2026.xml
- Removed sitemap https://www.dailymail.com/sitemap-topics.xml
Diff old (2026-07-07T20:35:12Z) → new (2026-08-19T17:42:34Z)
| @@ -1,4 +1,4 @@ | ||
| 1 | - # Robots.txt for https://www.dailymail.com/ updated 07/07/2026 | |
| 1 | + # Robots.txt for https://www.dailymail.com/ updated 19/08/2026 | |
| 2 | 2 | # |
| 3 | 3 | # |
| 4 | 4 | # Daily Mail content is made available for your personal and non-commercial |
| @@ -168,25 +168,16 @@ | ||
| 168 | 168 | # |
| 169 | 169 | # Sitemap Files |
| 170 | 170 | Sitemap: https://www.dailymail.com/google-news-sitemap.xml |
| 171 | - Sitemap: https://www.dailymail.com/sitemap-channels.xml | |
| 172 | - Sitemap: https://www.dailymail.com/sitemap-columnist.xml | |
| 173 | - Sitemap: https://www.dailymail.com/sitemap-topics.xml | |
| 171 | + Sitemap: https://www.dailymail.com/video-new-sitemap.xml | |
| 172 | + Sitemap: https://www.dailymail.com/sitemap-articles-year~2021.xml | |
| 173 | + Sitemap: https://www.dailymail.com/sitemap-articles-year~2022.xml | |
| 174 | + Sitemap: https://www.dailymail.com/sitemap-articles-year~2023.xml | |
| 175 | + Sitemap: https://www.dailymail.com/sitemap-articles-year~2024.xml | |
| 176 | + Sitemap: https://www.dailymail.com/sitemap-articles-year~2025.xml | |
| 177 | + Sitemap: https://www.dailymail.com/sitemap-articles-year~2026.xml | |
| 174 | 178 | Sitemap: https://www.dailymail.com/sitemap-videos-year~2021.xml |
| 175 | - Sitemap: https://www.dailymail.com/sitemap-facts-year~2021.xml | |
| 176 | - Sitemap: https://www.dailymail.com/sitemap-articles-year~2021.xml | |
| 177 | 179 | Sitemap: https://www.dailymail.com/sitemap-videos-year~2022.xml |
| 178 | - Sitemap: https://www.dailymail.com/sitemap-articles-year~2022.xml | |
| 179 | - Sitemap: https://www.dailymail.com/sitemap-facts-year~2022.xml | |
| 180 | 180 | Sitemap: https://www.dailymail.com/sitemap-videos-year~2023.xml |
| 181 | - Sitemap: https://www.dailymail.com/sitemap-articles-year~2023.xml | |
| 182 | - Sitemap: https://www.dailymail.com/sitemap-facts-year~2023.xml | |
| 183 | 181 | Sitemap: https://www.dailymail.com/sitemap-videos-year~2024.xml |
| 184 | - Sitemap: https://www.dailymail.com/sitemap-articles-year~2024.xml | |
| 185 | - Sitemap: https://www.dailymail.com/sitemap-facts-year~2024.xml | |
| 186 | 182 | Sitemap: https://www.dailymail.com/sitemap-videos-year~2025.xml |
| 187 | - Sitemap: https://www.dailymail.com/sitemap-articles-year~2025.xml | |
| 188 | - Sitemap: https://www.dailymail.com/sitemap-facts-year~2025.xml | |
| 189 | 183 | Sitemap: https://www.dailymail.com/sitemap-videos-year~2026.xml |
| 190 | - Sitemap: https://www.dailymail.com/sitemap-articles-year~2026.xml | |
| 191 | - Sitemap: https://www.dailymail.com/sitemap-facts-year~2026.xml | |
| 192 | - Sitemap: https://www.dailymail.com/sitemap-authors.xml |