The Associated Press / robots.txt
← back to apnews.com · change detected 29d ago (2026-10-08T22:07:02Z) · modified +1 −0
What changed
- Added Disallow: /*/widgets/ for *
Diff old (2026-08-22T00:26:44Z) → new (2026-10-08T22:07:02Z)
| @@ -17,6 +17,7 @@ | ||
| 17 | 17 | Disallow: /article/border-immigration-election-2182fec11fa008ec96c4202e5656d19e |
| 18 | 18 | Disallow: /api/v2/feed/ |
| 19 | 19 | Disallow: /press-release/* |
| 20 | + Disallow: /*/widgets/ | |
| 20 | 21 | |
| 21 | 22 | Sitemap: https://apnews.com/ap-sitemap.xml |
| 22 | 23 | Sitemap: https://apnews.com/news-sitemap-content.xml |