The New Yorker / robots.txt
← back to newyorker.com · change detected 1mo ago (2026-09-29T18:55:02Z) · modified +1 −0
What changed
- Added Disallow: */c_limit/ for *
Diff old (2026-09-08T18:06:18Z) → new (2026-09-29T18:55:02Z)
| @@ -31,6 +31,7 @@ | ||
| 31 | 31 | Disallow: /services.min.js |
| 32 | 32 | Disallow: /com.condenast/yv8 |
| 33 | 33 | Disallow: /reject-all |
| 34 | + Disallow: */c_limit/ | |
| 34 | 35 | |
| 35 | 36 | ### |
| 36 | 37 | Allow: /v2/offers/tnya |