Die Zeit / robots.txt
← back to zeit.de · change detected 2mo ago (2026-08-31T15:31:09Z) · modified +2 −0
What changed
- Formatting/comment-only change (no semantic difference)
Diff old (2026-07-02T12:51:16Z) → new (2026-08-31T15:31:09Z)
| @@ -1,3 +1,5 @@ | ||
| 1 | + # FALLBACK ONLY, instead edit here: https://dash.centinelanalytica.com/crawlers/robots-txt | |
| 2 | + | |
| 1 | 3 | User-agent: Googlebot-News |
| 2 | 4 | Disallow: /angebote/ |
| 3 | 5 |