Allstate / robots.txt snapshot
← back to allstate.com · fetched 2026-10-21T02:33:48Z (17d ago) · HTTP 200 · 643 bytes · sha256 11c3536163e5a0aa · raw
final URL: https://www.allstate.com/robots.txt
| 1 | User-Agent: * |
| 2 | Disallow: /_test* |
| 3 | Disallow: /allstate-benefits/* |
| 4 | Disallow: /credit |
| 5 | Disallow: /ddt-test-pages* |
| 6 | Disallow: /landingpages* |
| 7 | Disallow: /qat* |
| 8 | Disallow: /resources/allstate/attachments/* |
| 9 | Disallow: /resources/resourcetest |
| 10 | Disallow: /staff-counsel* |
| 11 | Disallow: /test* |
| 12 | Disallow: /es/_test* |
| 13 | Disallow: /es/allstate-benefits/* |
| 14 | Disallow: /es/auto-insurance/cars-trucks |
| 15 | Disallow: /es/credit |
| 16 | Disallow: /es/ddt-test-pages* |
| 17 | Disallow: /es/landingpages* |
| 18 | Disallow: /es/qat* |
| 19 | Disallow: /es/resources/allstate/attachments/* |
| 20 | Disallow: /es/resources/resourcetest |
| 21 | Disallow: /es/staff-counsel* |
| 22 | Disallow: /es/test* |
| 23 | Sitemap: https://www.allstate.com/sitemap.xml |