NeuralCrawl

Die Zeit / robots.txt

← back to zeit.de · change detected 2mo ago (2026-08-31T15:31:09Z) · modified +2 −0

What changed

Diff old (2026-07-02T12:51:16Z) → new (2026-08-31T15:31:09Z)

@@ -1,3 +1,5 @@
1+ # FALLBACK ONLY, instead edit here: https://dash.centinelanalytica.com/crawlers/robots-txt
2+
13  User-agent: Googlebot-News
24  Disallow: /angebote/
35