NeuralCrawl

Axel Springer / robots.txt snapshot

← back to axelspringer.com · fetched 2026-10-09T16:18:29Z (29d ago) · HTTP 200 · 179 bytes · sha256 afa0fe85ad91d006 · raw

final URL: https://www.axelspringer.com/robots.txt

1# START YOAST BLOCK
2# ---------------------------
3User-agent: *
4Disallow:
5
6Sitemap: https://www.axelspringer.com/sitemap_index.xml
7# ---------------------------
8# END YOAST BLOCK