๐ฉ๐ช Merck KGaA
merckgroup.com · European companies · rank #150 · Pharmaceuticals · live robots.txt ↗
AI crawler access (latest snapshot, 13h ago)
⛔blocked
restricted
✅allowed
faded = inherited from the * wildcard group
✅GPTBot
✅ChatGPT-User
✅OAI-SearchBot
✅ClaudeBot
✅Claude-User
✅Claude-SearchBot
✅anthropic-ai
✅Claude-Web
✅CCBot
✅Google-Extended
✅Applebot-Extended
✅PerplexityBot
✅Perplexity-User
✅Bytespider
✅Amazonbot
✅FacebookBot
✅meta-externalagent
✅meta-externalfetcher
✅cohere-ai
✅AI2Bot
✅Diffbot
✅omgili
✅YouBot
✅DuckAssistBot
✅MistralAI-User
✅PanguBot
✅Timpibot
Current robots.txt 525 bytes · sha256 85681c964b23 · raw
User-agent: * Disallow: /content/dam/web/corporate/non-images/company/responsibility/en/efpia-transparency-reporting-documents/ Disallow: /content/dam/web/corporate/non-images/business-specifics/performance-materials/Cosmetics/dermocosmetics/ Disallow: /search.merckgroup.com Disallow: /search.emdgroup.com Disallow: /en/expertise/industrial/template-page/*.html Disallow: /careers/job/job-detail.html Disallow: /content/dam/web/corporate/assets-hidden-from-search/ Allow: / Sitemap: https://www.emdgroup.com/en.sitemap.xml
Change history
-
initial snapshot
- First snapshot of robots.txt archived