NeuralCrawl

🇩🇪 Munich Re

munichre.com · European companies · rank #81 · Insurance · live robots.txt ↗

AI crawler access (latest snapshot, 13h ago)

⛔blocked restricted ✅allowed faded = inherited from the * wildcard group

✅GPTBot
✅ChatGPT-User
✅OAI-SearchBot
✅ClaudeBot
✅Claude-User
✅Claude-SearchBot
✅anthropic-ai
✅Claude-Web
✅CCBot
✅Google-Extended
✅Applebot-Extended
✅PerplexityBot
✅Perplexity-User
✅Bytespider
✅Amazonbot
✅FacebookBot
✅meta-externalagent
✅meta-externalfetcher
✅cohere-ai
✅AI2Bot
✅Diffbot
✅omgili
✅YouBot
✅DuckAssistBot
✅MistralAI-User
✅PanguBot
✅Timpibot

Current robots.txt 414 bytes · sha256 3a01d6f75a44 · raw 

Sitemap: https://www.munichre.com/sitemap.xml

User-agent: *
Disallow: /corporate-test/*
Disallow: /content/dam/munichre/brandportal/guidelines/*.pdf
Disallow: /content/dam/munichre/brandportal/guidelines/*/*.pdf
Disallow: /content/dam/munichre/brandportal/guidelines/*/*/*.pdf
Disallow: /content/dam/munichre/brandportal/guidelines/*/*/*/*.pdf
Disallow: /content/dam/munichre/brandportal/guidelines/*/*/*/*/*.pdf

Change history

  1. initial snapshot
    • First snapshot of robots.txt archived