Progressive / robots.txt
← back to progressive.com · change detected 2mo ago (2026-08-27T14:17:26Z) · modified +3 −0
What changed
- Added Disallow: /lifelanes/wp-content/ for *
- Added Disallow: /lifelanes/wp-content/ for AdsBot-Google
- Added Disallow: /lifelanes/wp-content/ for AdsBot-Google-Mobile
Diff old (2026-06-20T01:10:30Z) → new (2026-08-27T14:17:26Z)
| @@ -22,6 +22,7 @@ | ||
| 22 | 22 | Disallow:/Quote/ |
| 23 | 23 | Disallow:/aff-retrieve-quote/ |
| 24 | 24 | Disallow:/lp-agent/ |
| 25 | + Disallow:/lifelanes/wp-content/ | |
| 25 | 26 | |
| 26 | 27 | User-agent:AdsBot-Google |
| 27 | 28 | |
| @@ -46,6 +47,7 @@ | ||
| 46 | 47 | Disallow:/Quote/ |
| 47 | 48 | Disallow:/aff-retrieve-quote/ |
| 48 | 49 | Disallow:/lp-agent/ |
| 50 | + Disallow:/lifelanes/wp-content/ | |
| 49 | 51 | |
| 50 | 52 | User-agent:AdsBot-Google-Mobile |
| 51 | 53 | |
| @@ -70,5 +72,6 @@ | ||
| 70 | 72 | Disallow:/Quote/ |
| 71 | 73 | Disallow:/aff-retrieve-quote/ |
| 72 | 74 | Disallow:/lp-agent/ |
| 75 | + Disallow:/lifelanes/wp-content/ | |
| 73 | 76 | |
| 74 | 77 | Sitemap: https://www.progressive.com/sitemap.xml |