NeuralCrawl

Humana / robots.txt snapshot

← back to humana.com · fetched 2026-10-09T04:09:04Z (29d ago) · HTTP 200 · 1087 bytes · sha256 2bbe2285e5685c5f · raw

final URL: https://www.humana.com/robots.txt

1# Robots.txt file created by https://www.humana.com/
2# For domain: https://www.humana.com/
3# Updated 09-04-2023 - September 2023 release
4# Updated 10-05-2026 - explicit allow rules for verified AI/search crawler bots (CRC approved, see S0574)
5# All robots will spider the domain
6
7User-agent: *
8Disallow: /direct-connect-logon
9Disallow: /insurance-plan-quotes/
10Disallow: /medicare-secured/
11Disallow: /mvc/
12Disallow: /sitecore/
13
14# Network-level identity verification for the bots below (CIDR/reverse-DNS match)
15# is enforced at the Akamai/Shape WAF layer, not by this file.
16# OpenAI ChatGPT Search - CIDR verification feed: https://openai.com/searchbot.json
17User-agent: OAI-SearchBot
18Allow: /
19
20# Anthropic Claude - CIDR verification feed: https://claude.com/crawling/bots.json
21User-agent: Claude-SearchBot
22Allow: /
23
24User-agent: ClaudeBot
25Allow: /
26
27# Google - verified via common-crawlers.json/special-crawlers.json or reverse DNS (googlebot.com/googleusercontent.com/google.com)
28User-agent: Googlebot
29Allow: /
30
31User-agent: GoogleOther
32Allow: /
33
34Sitemap: https://www.humana.com/sitemap.xml