Allstate / robots.txt snapshot
← back to allstate.com · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 306 bytes · sha256 673a6463821fb4d3 · raw
final URL: https://www.allstate.com/robots.txt
| 1 | User-Agent: * |
| 2 | Sitemap: https://www.allstate.com/sitemap.xml |
| 3 | Disallow: /_test* |
| 4 | Disallow: /credit |
| 5 | Disallow: /landingpages* |
| 6 | Disallow: /qat* |
| 7 | Disallow: /resources/allstate/attachments/pdf/etr0509.pdf |
| 8 | Disallow: /resources/resourcetest |
| 9 | Disallow: /staff-counsel* |
| 10 | Disallow: /test* |
| 11 | Disallow: /tests* |
| 12 | Disallow: /api/ |