NeuralCrawl

South China Morning Post / robots.txt

← back to scmp.com · change detected 1mo ago (2026-09-24T10:55:22Z) · modified +0 −1

What changed

Diff old (2026-08-05T06:56:07Z) → new (2026-09-24T10:55:22Z)

@@ -156,7 +156,6 @@
156156  Disallow: /*/spmMonitor$
157157  Disallow: /*/util$
158158  Disallow: /*/windvane$
159- Disallow: /print/
160159 
161160  # Sitemap
162161  Sitemap: https://www.scmp.com/sitemap/sitemap.xml