The Associated Press / robots.txt
← back to apnews.com · change detected 15d ago (2026-10-23T15:24:48Z) · modified +1 −0
What changed
- Added Disallow: /scripts/CustomNews.js for *
Diff old (2026-10-22T21:05:52Z) → new (2026-10-23T15:24:48Z)
| @@ -18,6 +18,7 @@ | ||
| 18 | 18 | Disallow: /press-release/* |
| 19 | 19 | Disallow: /*/widgets/ |
| 20 | 20 | Disallow: /*/widget/ |
| 21 | + Disallow: /scripts/CustomNews.js | |
| 21 | 22 | |
| 22 | 23 | # Monitoring Test |
| 23 | 24 |