🇩🇪 DHL Group

dhl.com · European companies · rank #130 · Logistics · live robots.txt ↗

AI crawler access (latest snapshot, 13h ago)

⛔blocked restricted ✅allowed faded = inherited from the * wildcard group

✅GPTBot

✅ChatGPT-User

✅OAI-SearchBot

✅ClaudeBot

✅Claude-User

✅Claude-SearchBot

✅anthropic-ai

✅Claude-Web

✅CCBot

✅Google-Extended

✅Applebot-Extended

✅PerplexityBot

✅Perplexity-User

✅Bytespider

✅Amazonbot

✅FacebookBot

✅meta-externalagent

✅meta-externalfetcher

✅cohere-ai

✅AI2Bot

✅Diffbot

✅omgili

✅YouBot

✅DuckAssistBot

✅MistralAI-User

✅PanguBot

✅Timpibot

Current robots.txt 1621 bytes · sha256 8ef11cc9794c · raw

# Version 27.02.2026
# https://www.dhl.com/

# Settings for Norconex Crawler and the Cloud Native Crawler (for GCS)
User-agent: dhl-cloud-crawler
User-agent: dhl-norconex-crawler
Allow: /
Disallow: /master/
Disallow: /content/
Disallow: /DatPublic/
Disallow: /v1/mailitems
Disallow: /TrackReport/

User-agent: *
Allow: /
Disallow: /master/
Disallow: /DatPublic/
Disallow: /v1/mailitems
Disallow: /TrackReport/
Disallow: /sureroute-test-object.html
Disallow: /at-en/home/global-forwarding/help-center/claims-complaints-compliments-form.html
Disallow: /at-de/home/global-forwarding/help-center/claims-complaints-compliments-form.html
Disallow: /at-de/home/globale-weiterleitung/hilfecenter/claims-complaints-compliments-form.html
Disallow: /lu-en/home/global-forwarding/help-center/claims-complaints-compliments-form.html
Disallow: /lu-de/home/global-forwarding/help-center/claims-complaints-compliments-form.html
Disallow: /lu-de/home/globale-weiterleitung/hilfecenter/claims-complaints-compliments-form.html
Disallow: /lu-fr/home/global-forwarding/help-center/claims-complaints-compliments-form.html
Disallow: /lu-fr/home/expediteur-mondial/centre-d-assistance/claims-complaints-compliments-form.html
Disallow: /_sec/*

# Discover
Disallow: /discover/*/search-results
Disallow: /discover/*/download-thanks
Disallow: /discover/*/open-an-account/thanks
Disallow: /discover/*/open-an-account/*/thank-you

# GCCP
Disallow: /express/mydhl/perfectyourshipment
Disallow: /cp

# eCS Finder
Disallow: /fragments/dhl-finder-v1

Sitemap: https://www.dhl.com/sitemap-index.xml
Sitemap: https://www.dhl.com/discover/sitemap-index.xml

Change history

initial 13h ago snapshot
- First snapshot of robots.txt archived