🇩🇰 DSV
dsv.com · European companies · rank #132 · Logistics · live robots.txt ↗
AI crawler access (latest snapshot, 13h ago)
⛔blocked
restricted
✅allowed
faded = inherited from the * wildcard group
✅GPTBot
✅ChatGPT-User
✅OAI-SearchBot
✅ClaudeBot
✅Claude-User
✅Claude-SearchBot
✅anthropic-ai
✅Claude-Web
✅CCBot
✅Google-Extended
✅Applebot-Extended
✅PerplexityBot
✅Perplexity-User
✅Bytespider
✅Amazonbot
✅FacebookBot
✅meta-externalagent
✅meta-externalfetcher
✅cohere-ai
✅AI2Bot
✅Diffbot
✅omgili
✅YouBot
✅DuckAssistBot
✅MistralAI-User
✅PanguBot
✅Timpibot
Current robots.txt 1516 bytes · sha256 2a4dfebe6ac4 · raw
User-agent: * Sitemap: https://www.dsv.com/en/sitemap.xml Sitemap: https://www.dsv.com/pl-pl/sitemap.xml Sitemap: https://www.dsv.com/ru-ru/sitemap.xml Sitemap: https://www.dsv.com/ro-ro/sitemap.xml Sitemap: https://www.dsv.com/bg-bg/sitemap.xml Sitemap: https://www.dsv.com/en-za/sitemap.xml Sitemap: https://www.dsv.com/es-es/sitemap.xml Sitemap: https://www.dsv.com/en-us/sitemap.xml Sitemap: https://www.dsv.com/en-gb/sitemap.xml Sitemap: https://www.dsv.com/en-be/sitemap.xml Sitemap: https://www.dsv.com/sv-se/sitemap.xml Sitemap: https://www.dsv.com/fr-fr/sitemap.xml Sitemap: https://www.dsv.com/et-ee/sitemap.xml Sitemap: https://www.dsv.com/de-de/sitemap.xml Sitemap: https://www.dsv.com/da-dk/sitemap.xml Sitemap: https://www.dsv.com/es-mx/sitemap.xml Sitemap: https://www.dsv.com/en-cn/sitemap.xml Sitemap: https://www.dsv.com/fi-fi/sitemap.xml Sitemap: https://www.dsv.com/nb-no/sitemap.xml Sitemap: https://www.dsv.com/en-ca/sitemap.xml Sitemap: https://www.dsv.com/nl-nl/sitemap.xml Sitemap: https://www.dsv.com/en-nl/sitemap.xml Sitemap: https://www.dsv.com/fr-ca/sitemap.xml Sitemap: https://www.dsv.com/cs-cz/sitemap.xml Sitemap: https://www.dsv.com/it-it/sitemap.xml Sitemap: https://www.dsv.com/zh-cn/sitemap.xml Sitemap: https://www.dsv.com/en-ch/sitemap.xml Sitemap: https://www.dsv.com/en-in/sitemap.xml Sitemap: https://www.dsv.com/pt-br/sitemap.xml Sitemap: https://www.dsv.com/en-ae/sitemap.xml Sitemap: https://www.dsv.com/ar-ae/sitemap.xml Sitemap: https://www.dsv.com/sitemap_index.xml
Change history
-
initial snapshot
- First snapshot of robots.txt archived