Markel Group / robots.txt snapshot
← back to markel.com · fetched 2026-06-20T01:10:31Z (18h ago) · HTTP 200 · 328 bytes · sha256 c7d2904cac22ff81 · raw
final URL: https://www.markel.com/robots.txt
| 1 | user-agent: SemrushBot |
| 2 | allow: / |
| 3 | |
| 4 | user-agent: * |
| 5 | disallow: /sitecore/ |
| 6 | disallow: /Sitecore/ |
| 7 | disallow: /sitecore_files/ |
| 8 | disallow: /sitecore modules/ |
| 9 | disallow: /App_Browsers/ |
| 10 | disallow: /App_config/ |
| 11 | disallow: /App_Data/ |
| 12 | disallow: /temp/ |
| 13 | disallow: /upload/ |
| 14 | disallow: /xsl/ |
| 15 | disallow: /bin/ |
| 16 | |
| 17 | Sitemap: https://www.markel.com/sitemap.xml |
| 18 |