NeuralCrawl

Progressive / robots.txt

← back to progressive.com · change detected 16d ago (2026-10-22T15:00:52Z) · modified +2 −0

What changed

Diff old (2026-10-08T16:07:06Z) → new (2026-10-22T15:00:52Z)

@@ -26,6 +26,8 @@
2626  Disallow:/lifelanes/wp-content/
2727  Disallow:/*.asp
2828  Disallow:/agent/local-agent/
29+ Disallow:/*?slssid=
30+ Disallow:/*?subid=
2931 
3032  User-agent:AdsBot-Google
3133