NeuralCrawl

Allstate / robots.txt

← back to allstate.com · change detected 17d ago (2026-10-21T02:33:48Z) · modified +0 −2

What changed

Diff old (2026-10-01T01:22:45Z) → new (2026-10-21T02:33:48Z)

@@ -4,7 +4,6 @@
44  Disallow: /credit
55  Disallow: /ddt-test-pages*
66  Disallow: /landingpages*
7- Disallow: /personal
87  Disallow: /qat*
98  Disallow: /resources/allstate/attachments/*
109  Disallow: /resources/resourcetest
@@ -16,7 +15,6 @@
1615  Disallow: /es/credit
1716  Disallow: /es/ddt-test-pages*
1817  Disallow: /es/landingpages*
19- Disallow: /es/personal
2018  Disallow: /es/qat*
2119  Disallow: /es/resources/allstate/attachments/*
2220  Disallow: /es/resources/resourcetest