Allstate / robots.txt snapshot

← back to allstate.com · fetched 2026-10-01T01:22:45Z (1mo ago) · HTTP 200 · 686 bytes · sha256 8dde2b540c7783eb · raw

final URL: https://www.allstate.com/robots.txt

1	User-Agent: *
2	Disallow: /_test*
3	Disallow: /allstate-benefits/*
4	Disallow: /credit
5	Disallow: /ddt-test-pages*
6	Disallow: /landingpages*
7	Disallow: /personal
8	Disallow: /qat*
9	Disallow: /resources/allstate/attachments/*
10	Disallow: /resources/resourcetest
11	Disallow: /staff-counsel*
12	Disallow: /test*
13	Disallow: /es/_test*
14	Disallow: /es/allstate-benefits/*
15	Disallow: /es/auto-insurance/cars-trucks
16	Disallow: /es/credit
17	Disallow: /es/ddt-test-pages*
18	Disallow: /es/landingpages*
19	Disallow: /es/personal
20	Disallow: /es/qat*
21	Disallow: /es/resources/allstate/attachments/*
22	Disallow: /es/resources/resourcetest
23	Disallow: /es/staff-counsel*
24	Disallow: /es/test*
25	Sitemap: https://www.allstate.com/sitemap.xml