DHL Group / robots.txt snapshot
← back to dhl.com · fetched 2026-07-17T18:17:47Z (20d ago) · HTTP 200 · 1240 bytes · sha256 49121dbda821359d · raw
final URL: https://www.dhl.com/robots.txt
| 1 | # Version 17.07.2026 |
| 2 | # https://www.dhl.com/ |
| 3 | |
| 4 | # Settings for Norconex Crawler and the Cloud Native Crawler (for GCS) |
| 5 | User-agent: dhl-cloud-crawler |
| 6 | User-agent: dhl-norconex-crawler |
| 7 | Allow: / |
| 8 | Disallow: /master/ |
| 9 | Disallow: /content/ |
| 10 | Disallow: /DatPublic/ |
| 11 | Disallow: /v1/mailitems |
| 12 | Disallow: /TrackReport/ |
| 13 | |
| 14 | User-agent: * |
| 15 | Allow: / |
| 16 | Disallow: /master/ |
| 17 | Disallow: /DatPublic/ |
| 18 | Disallow: /v1/mailitems |
| 19 | Disallow: /TrackReport/ |
| 20 | Disallow: /sureroute-test-object.html |
| 21 | Disallow: /at-en/home/global-forwarding/help-center/claims-complaints-compliments-form.html |
| 22 | Disallow: /at-de/home/global-forwarding/help-center/claims-complaints-compliments-form.html |
| 23 | Disallow: /at-de/home/globale-weiterleitung/hilfecenter/claims-complaints-compliments-form.html |
| 24 | Disallow: /lu-de/home/global-forwarding/help-center/claims-complaints-compliments-form.html |
| 25 | Disallow: /_sec/* |
| 26 | |
| 27 | # Discover |
| 28 | Disallow: /discover/*/search-results |
| 29 | Disallow: /discover/*/download-thanks |
| 30 | Disallow: /discover/*/open-an-account/thanks |
| 31 | Disallow: /discover/*/open-an-account/*/thank-you |
| 32 | |
| 33 | # GCCP |
| 34 | Disallow: /express/mydhl/perfectyourshipment |
| 35 | Disallow: /cp |
| 36 | |
| 37 | # eCS Finder |
| 38 | Disallow: /fragments/dhl-finder-v1 |
| 39 | |
| 40 | Sitemap: https://www.dhl.com/sitemap-index.xml |
| 41 | Sitemap: https://www.dhl.com/discover/sitemap-index.xml |