NeuralCrawl

Allstate / robots.txt snapshot

← back to allstate.com · fetched 2026-10-21T02:33:48Z (17d ago) · HTTP 200 · 643 bytes · sha256 11c3536163e5a0aa · raw

final URL: https://www.allstate.com/robots.txt

1User-Agent: *
2Disallow: /_test*
3Disallow: /allstate-benefits/*
4Disallow: /credit
5Disallow: /ddt-test-pages*
6Disallow: /landingpages*
7Disallow: /qat*
8Disallow: /resources/allstate/attachments/*
9Disallow: /resources/resourcetest
10Disallow: /staff-counsel*
11Disallow: /test*
12Disallow: /es/_test*
13Disallow: /es/allstate-benefits/*
14Disallow: /es/auto-insurance/cars-trucks
15Disallow: /es/credit
16Disallow: /es/ddt-test-pages*
17Disallow: /es/landingpages*
18Disallow: /es/qat*
19Disallow: /es/resources/allstate/attachments/*
20Disallow: /es/resources/resourcetest
21Disallow: /es/staff-counsel*
22Disallow: /es/test*
23Sitemap: https://www.allstate.com/sitemap.xml