The New York Times / robots.txt
← back to nytimes.com · change detected 14d ago (2026-09-04T23:01:05Z) · modified +2 −0
What changed
- Added Allow: /athletic/live-blogs/discuss/ for *
- Added Allow: /athletic/mlb/game/discuss/ for *
- Added Allow: /athletic/live-blogs/discuss/ for Googlebot
- Added Allow: /athletic/mlb/game/discuss/ for Googlebot
Diff old (2026-08-27T20:19:03Z) → new (2026-09-04T23:01:05Z)
| @@ -35,6 +35,8 @@ | ||
| 35 | 35 | Allow: /athletic/login2/$ |
| 36 | 36 | Disallow: /athletic/report/ |
| 37 | 37 | Disallow: /athletic/*/discuss/* |
| 38 | + Allow: /athletic/live-blogs/discuss/ | |
| 39 | + Allow: /athletic/mlb/game/discuss/ | |
| 38 | 40 | Disallow: /athletic/register/ |
| 39 | 41 | Disallow: /athletic/register?welcome_redirect* |
| 40 | 42 | Disallow: /athletic/register2/ |