Daily Mail / robots.txt
← back to dailymail.co.uk · change detected 1mo ago (2026-07-03T13:16:54Z) · modified +2 −1
What changed
- Added Disallow: /news/the-harry-trial/* for *
Diff old (2026-06-20T01:10:30Z) → new (2026-07-03T13:16:54Z)
| @@ -1,4 +1,4 @@ | ||
| 1 | - # Robots.txt for https://www.dailymail.com/ updated 20/04/2026 | |
| 1 | + # Robots.txt for https://www.dailymail.com/ updated 03/07/2026 | |
| 2 | 2 | # |
| 3 | 3 | # |
| 4 | 4 | # Daily Mail content is made available for your personal and non-commercial |
| @@ -41,6 +41,7 @@ | ||
| 41 | 41 | Disallow: /api/infinite-list.html |
| 42 | 42 | Disallow: /api/infinite-list.html |
| 43 | 43 | Disallow: /mobileapps/* |
| 44 | + Disallow: /news/the-harry-trial/* | |
| 44 | 45 | |
| 45 | 46 | # |
| 46 | 47 | # Disallow Money for Google News |