NeuralCrawl

Newsweek / robots.txt

← back to newsweek.com · change detected 15d ago (2026-10-23T03:13:22Z) · modified +1 −0

What changed

Diff old (2026-06-20T01:10:30Z) → new (2026-10-23T03:13:22Z)

@@ -5,6 +5,7 @@
55  Disallow: /eyeblaster
66  Disallow: /doubleclick/
77  Disallow: /ads/sponsored
8+ Disallow: /_fs-ch-1T1wmsGaOgGaSxcX/
89 
910  # Disallow Bots
1011  User-agent: Amazonbot