Penske Automotive Group / robots.txt snapshot
← back to penskeautomotive.com · fetched 2026-08-06T13:18:41Z (3mo ago) · HTTP 200 · 169 bytes · sha256 f71b22cbc7473ef0 · raw
final URL: https://www.penskeautomotive.com/robots.txt
| 1 | |
| 2 | |
| 3 | |
| 4 | User-agent: * |
| 5 | |
| 6 | Disallow: /user_area/ |
| 7 | Disallow: /api/ |
| 8 | Sitemap: https://www.penskeautomotive.com/sitemap.xml |
| 9 | Sitemap: https://www.penskeautomotive.com/sitemap-cars.xml |