South China Morning Post / robots.txt
← back to scmp.com · change detected 1mo ago (2026-06-29T11:44:49Z) · modified +2 −0
What changed
- Added Disallow: /search/* for *
- Added Disallow: /search?q=* for *
Diff old (2026-06-20T01:10:30Z) → new (2026-06-29T11:44:49Z)
| @@ -157,6 +157,8 @@ | ||
| 157 | 157 | Disallow: /*/lib_b/*$ |
| 158 | 158 | Disallow: /print/ |
| 159 | 159 | Disallow: /?q=print/ |
| 160 | + Disallow: /search?q=* | |
| 161 | + Disallow: /search/* | |
| 160 | 162 | |
| 161 | 163 | # NewsNow |
| 162 | 164 | User-agent: NewsNow |