NeuralCrawl

Die Zeit / robots.txt

← back to zeit.de · change detected 2mo ago (2026-09-04T16:59:44Z) · modified +0 −2

What changed

Diff old (2026-08-31T15:31:09Z) → new (2026-09-04T16:59:44Z)

@@ -1,5 +1,3 @@
1- # FALLBACK ONLY, instead edit here: https://dash.centinelanalytica.com/crawlers/robots-txt
2-
31  User-agent: Googlebot-News
42  Disallow: /angebote/
53