Craigslist / robots.txt snapshot
← back to craigslist.org · fetched 2026-07-10T03:49:59Z (28d ago) · HTTP 200 · 151 bytes · sha256 5a9a92114f608593 · raw
final URL: https://craigslist.org/robots.txt
| 1 | User-agent: * |
| 2 | Disallow: /reply |
| 3 | Disallow: /fb/ |
| 4 | Disallow: /suggest |
| 5 | Disallow: /flag |
| 6 | Disallow: /mf |
| 7 | Disallow: /mailflag |
| 8 | Disallow: /eaf |
| 9 | |
| 10 | Disallow: /sitemap/ |