NeuralCrawl

The Associated Press / robots.txt

← back to apnews.com · change detected 2mo ago (2026-08-22T00:26:44Z) · modified +1 −0

What changed

Diff old (2026-06-20T01:10:30Z) → new (2026-08-22T00:26:44Z)

@@ -22,6 +22,7 @@
2222  Sitemap: https://apnews.com/news-sitemap-content.xml
2323  Sitemap: https://apnews.com/hubs-sitemap-content.xml
2424  Sitemap: https://apnews.com/video-sitemap.xml
25+ Sitemap: https://apnews.com/author-sitemap-content.xml
2526  Sitemap: https://apnews.com/projects/elections-2026/sitemap-index.xml
2627 
2728  # Disallow Rules