The New York Times / robots.txt
← back to nytimes.com · change detected 24d ago (2026-10-13T23:51:59Z) · modified +1 −1
What changed
- Added Allow: /athletic/nfl/game/discuss/ for *
- Removed Allow: /athletic/mlb/game/discuss/ for *
- Added Allow: /athletic/nfl/game/discuss/ for Googlebot
- Removed Allow: /athletic/mlb/game/discuss/ for Googlebot
Diff old (2026-09-04T23:01:05Z) → new (2026-10-13T23:51:59Z)
| @@ -36,7 +36,7 @@ | ||
| 36 | 36 | Disallow: /athletic/report/ |
| 37 | 37 | Disallow: /athletic/*/discuss/* |
| 38 | 38 | Allow: /athletic/live-blogs/discuss/ |
| 39 | - Allow: /athletic/mlb/game/discuss/ | |
| 39 | + Allow: /athletic/nfl/game/discuss/ | |
| 40 | 40 | Disallow: /athletic/register/ |
| 41 | 41 | Disallow: /athletic/register?welcome_redirect* |
| 42 | 42 | Disallow: /athletic/register2/ |