Yahoo Search / robots.txt
← back to yahoo.com · change detected 1mo ago (2026-10-05T21:12:18Z) · modified +0 −4
What changed
- Removed sitemap https://www.yahoo.com/news-sitemap-index.xml
- Removed sitemap https://www.yahoo.com/news/weather/sitemap.xml
- Removed sitemap https://www.yahoo.com/sitemap-index.xml
Diff old (2026-06-20T14:56:27Z) → new (2026-10-05T21:12:18Z)
| @@ -69,7 +69,3 @@ | ||
| 69 | 69 | User-agent: Claude-SearchBot |
| 70 | 70 | User-agent: OAI-SearchBot |
| 71 | 71 | Disallow: */articles/ |
| 72 | - | |
| 73 | - Sitemap: https://www.yahoo.com/news/weather/sitemap.xml | |
| 74 | - Sitemap: https://www.yahoo.com/news-sitemap-index.xml | |
| 75 | - Sitemap: https://www.yahoo.com/sitemap-index.xml |