Craigslist / robots.txt
← back to craigslist.org · change detected 28d ago (2026-07-10T03:49:59Z) · modified +1 −1
What changed
- Added Disallow: /sitemap/ for *
Diff old (2026-06-26T13:23:15Z) → new (2026-07-10T03:49:59Z)
| @@ -7,4 +7,4 @@ | ||
| 7 | 7 | Disallow: /mailflag |
| 8 | 8 | Disallow: /eaf |
| 9 | 9 | |
| 10 | - | |
| 10 | + Disallow: /sitemap/ |