Axel Springer / robots.txt
← back to axelspringer.com · change detected 29d ago (2026-10-09T16:18:29Z) · modified +6 −3
What changed
- Added Disallow: (empty) for *
- Removed Allow: /wp-admin/admin-ajax.php for *
- Removed Disallow: /wp-admin/ for *
- Added sitemap https://www.axelspringer.com/sitemap_index.xml
- Removed sitemap https://www.axelspringer.com/wp-sitemap.xml
Diff old (2026-06-20T01:10:30Z) → new (2026-10-09T16:18:29Z)
| @@ -1,5 +1,8 @@ | ||
| 1 | + # START YOAST BLOCK | |
| 2 | + # --------------------------- | |
| 1 | 3 | User-agent: * |
| 2 | - Disallow: /wp-admin/ | |
| 3 | - Allow: /wp-admin/admin-ajax.php | |
| 4 | + Disallow: | |
| 4 | 5 | |
| 5 | - Sitemap: https://www.axelspringer.com/wp-sitemap.xml | |
| 6 | + Sitemap: https://www.axelspringer.com/sitemap_index.xml | |
| 7 | + # --------------------------- | |
| 8 | + # END YOAST BLOCK |