Daily Mail / robots.txt
← back to dailymail.co.uk · change detected 1mo ago (2026-07-07T20:35:12Z) · modified +1 −2
What changed
- Removed Disallow: /news/the-harry-trial/* for *
Diff old (2026-07-03T13:16:54Z) → new (2026-07-07T20:35:12Z)
| @@ -1,4 +1,4 @@ | ||
| 1 | - # Robots.txt for https://www.dailymail.com/ updated 03/07/2026 | |
| 1 | + # Robots.txt for https://www.dailymail.com/ updated 07/07/2026 | |
| 2 | 2 | # |
| 3 | 3 | # |
| 4 | 4 | # Daily Mail content is made available for your personal and non-commercial |
| @@ -41,7 +41,6 @@ | ||
| 41 | 41 | Disallow: /api/infinite-list.html |
| 42 | 42 | Disallow: /api/infinite-list.html |
| 43 | 43 | Disallow: /mobileapps/* |
| 44 | - Disallow: /news/the-harry-trial/* | |
| 45 | 44 | |
| 46 | 45 | # |
| 47 | 46 | # Disallow Money for Google News |