The New Yorker / robots.txt
← back to newyorker.com · change detected 2mo ago (2026-09-08T18:06:18Z) · modified +1 −0
What changed
- Added Disallow: /reject-all for *
Diff old (2026-09-08T12:01:45Z) → new (2026-09-08T18:06:18Z)
| @@ -30,6 +30,7 @@ | ||
| 30 | 30 | Disallow: /cdn-cgi/ |
| 31 | 31 | Disallow: /services.min.js |
| 32 | 32 | Disallow: /com.condenast/yv8 |
| 33 | + Disallow: /reject-all | |
| 33 | 34 | |
| 34 | 35 | ### |
| 35 | 36 | Allow: /v2/offers/tnya |