South China Morning Post / robots.txt
← back to scmp.com · change detected 8d ago (2026-07-29T10:28:28Z) · modified +0 −2
What changed
- Removed Disallow: /search/* for *
- Removed Disallow: /search?q=* for *
Diff old (2026-07-28T10:03:18Z) → new (2026-07-29T10:28:28Z)
| @@ -153,8 +153,6 @@ | ||
| 153 | 153 | Disallow: /*/util$ |
| 154 | 154 | Disallow: /*/windvane$ |
| 155 | 155 | Disallow: /print/ |
| 156 | - Disallow: /search?q=* | |
| 157 | - Disallow: /search/* | |
| 158 | 156 | |
| 159 | 157 | # Sitemap |
| 160 | 158 | Sitemap: https://www.scmp.com/sitemap/sitemap.xml |