🇺🇸 Gilead Sciences

gilead.com · US 500 · rank #125 · Health Care · live robots.txt ↗

AI crawler access (latest snapshot, 1d ago)

⛔blocked restricted ✅allowed faded = inherited from the * wildcard group

✅GPTBot

✅ChatGPT-User

✅OAI-SearchBot

✅ClaudeBot

✅Claude-User

✅Claude-SearchBot

✅anthropic-ai

✅Claude-Web

✅CCBot

✅Google-Extended

✅Applebot-Extended

✅PerplexityBot

✅Perplexity-User

✅Bytespider

✅Amazonbot

✅FacebookBot

✅meta-externalagent

✅meta-externalfetcher

✅cohere-ai

✅AI2Bot

✅Diffbot

✅omgili

✅YouBot

✅DuckAssistBot

✅MistralAI-User

✅PanguBot

✅Timpibot

Current robots.txt 2358 bytes · sha256 4df5038c2c90 · raw

User-agent: *
Allow: /
Disallow: /bin/
Disallow: /xsl/
Disallow: /layouts/
Disallow: /sitecore/
Disallow: /App_Data/
Disallow: /includes/
Disallow: /App_config/
Disallow: /App_Browsers/
Disallow: /sitecore_files/
Disallow: /sitecore/shell/
Disallow: /sitecore modules/
Disallow: /sitecore/modules/
Disallow: /sitecore/service/
Disallow: /sitecore/content/
Disallow: /sitecore/media library/
Disallow: /-/media/gileadspain/pdfs/about/transparency/gilead-sciences-spain-efpia-report-2024.pdf
Disallow: /-/media/gileadturkey/pdfs/about-us/20211209-ticaret-sicil-gazetesi---temsil-ve-dier.pdf
Disallow: /-/media/gileadspain/pdfs/about/transparency/gilead-sciences-spain-efpia-methodological-note-2024.pdf
Disallow: /-/media/gileadspain/pdfs/about/transparency/gilead-sciences-efpia-patient-organisation-support-2024.pdf
Disallow: /-/media/gileadspain/pdfs/about/transparency/gilead-sciences-spain-relationships-with-patient-organizations-methodological-note-2024.pdf

Sitemap: https://www.gilead.com/sitemap.xml
Sitemap: https://www.gilead.com/en-il/sitemap.xml
Sitemap: https://www.gilead.com/ar-il/sitemap.xml
Sitemap: https://www.gilead.com/he-il/sitemap.xml
Sitemap: https://www.gilead.com/en-be/sitemap.xml
Sitemap: https://www.gilead.com/nl-be/sitemap.xml
Sitemap: https://www.gilead.com/fr-be/sitemap.xml
Sitemap: https://www.gilead.com/en-se/sitemap.xml
Sitemap: https://www.gilead.com/en-gr/sitemap.xml
Sitemap: https://www.gilead.com/el-gr/sitemap.xml
Sitemap: https://www.gilead.com/en-ch/sitemap.xml
Sitemap: https://www.gilead.com/de-ch/sitemap.xml
Sitemap: https://www.gilead.com/fr-ch/sitemap.xml
Sitemap: https://www.gilead.com/en-uk/sitemap.xml
Sitemap: https://www.gilead.com/en-au/sitemap.xml
Sitemap: https://www.gilead.com/es-es/sitemap.xml
Sitemap: https://www.gilead.com/fr-ca/sitemap.xml
Sitemap: https://www.gilead.com/en-ca/sitemap.xml
Sitemap: https://www.gilead.com/de-de/sitemap.xml
Sitemap: https://www.gilead.com/de-at/sitemap.xml
Sitemap: https://www.gilead.com/tr-tr/sitemap.xml
Sitemap: https://www.gilead.com/it-it/sitemap.xml
Sitemap: https://www.gilead.com/zh-hk/sitemap.xml
Sitemap: https://www.gilead.com/en-hk/sitemap.xml
Sitemap: https://www.gilead.com/ja-jp/sitemap.xml
Sitemap: https://www.gilead.com/zh-tw/sitemap.xml
Sitemap: https://www.gilead.com/ko-kr/sitemap.xml
Sitemap: https://www.gilead.com/fr-fr/sitemap.xml

Compare any two snapshots

Change history

modified 1d ago +4 −4 view diff → snapshot
- Formatting/comment-only change (no semantic difference)
modified 1d ago +5 −5 view diff → snapshot
- Formatting/comment-only change (no semantic difference)
initial 6d ago snapshot
- First snapshot of robots.txt archived