NeuralCrawl

🇺🇸 Cencora

cencora.com · US 500 · rank #10 · Health Care · live robots.txt ↗

AI crawler access (latest snapshot, 5h ago)

⛔blocked restricted ✅allowed faded = inherited from the * wildcard group

✅GPTBot
✅ChatGPT-User
✅OAI-SearchBot
✅ClaudeBot
✅Claude-User
✅Claude-SearchBot
✅anthropic-ai
✅Claude-Web
✅CCBot
✅Google-Extended
✅Applebot-Extended
✅PerplexityBot
✅Perplexity-User
✅Bytespider
✅Amazonbot
✅FacebookBot
✅meta-externalagent
✅meta-externalfetcher
✅cohere-ai
✅AI2Bot
✅Diffbot
✅omgili
✅YouBot
✅DuckAssistBot
✅MistralAI-User
✅PanguBot
✅Timpibot

Current robots.txt 957 bytes · sha256 c9695c7ee526 · raw 

User-agent: DequeAxeMonitoring
Allow: /

User-agent: SiteAuditBot
Crawl-delay: 1
Allow: /

User-agent: LinkedInBot
Allow: /

User-agent: Semrushbot-SI
Allow: /

User-agent: *
Disallow: /initiatives*
Disallow: /es/initiatives*
Disallow: /de/initiatives*
Disallow: /fr/initiatives*
Disallow: /ca/initiatives*
Disallow: /nl/initiatives*
Disallow: /no/initiatives*
Disallow: /it/initiatives*
Disallow: /ro/initiatives*
Disallow: /cz/initiatives*
Disallow: /tr/initiatives*
Disallow: /*thank-you
Disallow: /-/media/assets/corporate/aps/25-pah-10275-pharmacy-outlook-booklet-2025-02dec25-v5-fnl-digital.pdf
Disallow: /Global-reach/Europe/United-Kingdom/Legal-regulatory-hub/Almus-NetGen-Terms-Conditions
Disallow: /Global-reach/Europe/United-Kingdom/Legal-regulatory-hub/BE-Force-terms-conditions
Disallow: /Global-reach/Europe/United-Kingdom/Legal-regulatory-hub/pharmacyone-brand-equalisation-terms

Crawl-delay: 5

Sitemap: https://www.cencora.com/sitemap.xml

Compare any two snapshots

Change history

  1. modified +3 −1 view diff → snapshot
    • Added Disallow: /Global-reach/Europe/United-Kingdom/Legal-regulatory-hub/Almus-NetGen-Terms-Conditions for *
    • Added Disallow: /Global-reach/Europe/United-Kingdom/Legal-regulatory-hub/BE-Force-terms-conditions for *
    • Added Disallow: /Global-reach/Europe/United-Kingdom/Legal-regulatory-hub/pharmacyone-brand-equalisation-terms for *
    • Removed Disallow: /web-team-requests for *
  2. modified +0 −32 view diff → snapshot
    • Removed Disallow: /initiatives/pharma/formularydecisions-connection-newsletter/* for *
    • Removed Disallow: /initiatives/pharma/formularydecisions-insider-newsletter/* for *
  3. initial snapshot
    • First snapshot of robots.txt archived