DHL Group / robots.txt
← back to dhl.com · change detected 20d ago (2026-07-17T18:17:47Z) · modified +1 −5
What changed
- Removed Disallow: /lu-de/home/globale-weiterleitung/hilfecenter/claims-complaints-compliments-form.html for *
- Removed Disallow: /lu-en/home/global-forwarding/help-center/claims-complaints-compliments-form.html for *
- Removed Disallow: /lu-fr/home/expediteur-mondial/centre-d-assistance/claims-complaints-compliments-form.html for *
- Removed Disallow: /lu-fr/home/global-forwarding/help-center/claims-complaints-compliments-form.html for *
Diff old (2026-06-20T01:10:30Z) → new (2026-07-17T18:17:47Z)
| @@ -1,4 +1,4 @@ | ||
| 1 | - # Version 27.02.2026 | |
| 1 | + # Version 17.07.2026 | |
| 2 | 2 | # https://www.dhl.com/ |
| 3 | 3 | |
| 4 | 4 | # Settings for Norconex Crawler and the Cloud Native Crawler (for GCS) |
| @@ -21,11 +21,7 @@ | ||
| 21 | 21 | Disallow: /at-en/home/global-forwarding/help-center/claims-complaints-compliments-form.html |
| 22 | 22 | Disallow: /at-de/home/global-forwarding/help-center/claims-complaints-compliments-form.html |
| 23 | 23 | Disallow: /at-de/home/globale-weiterleitung/hilfecenter/claims-complaints-compliments-form.html |
| 24 | - Disallow: /lu-en/home/global-forwarding/help-center/claims-complaints-compliments-form.html | |
| 25 | 24 | Disallow: /lu-de/home/global-forwarding/help-center/claims-complaints-compliments-form.html |
| 26 | - Disallow: /lu-de/home/globale-weiterleitung/hilfecenter/claims-complaints-compliments-form.html | |
| 27 | - Disallow: /lu-fr/home/global-forwarding/help-center/claims-complaints-compliments-form.html | |
| 28 | - Disallow: /lu-fr/home/expediteur-mondial/centre-d-assistance/claims-complaints-compliments-form.html | |
| 29 | 25 | Disallow: /_sec/* |
| 30 | 26 | |
| 31 | 27 | # Discover |