NeuralCrawl

The Economist / robots.txt

← back to economist.com · change detected 1mo ago (2026-09-23T16:51:28Z) · modified +1 −0

What changed

Diff old (2026-08-20T18:05:43Z) → new (2026-09-23T16:51:28Z)

@@ -130,6 +130,7 @@
130130  Disallow: /search/
131131  Disallow: /search?q=
132132  Disallow: /graphql
133+ Disallow: /api
133134  Disallow: /subscribe/getstarted/
134135  Disallow: /checkout
135136  Disallow: /switch*