NeuralCrawl

🇺🇸 Molina Healthcare

molinahealthcare.com · US 500 · rank #130 · Health Care · live robots.txt ↗

AI crawler access (latest snapshot, 5h ago)

⛔blocked restricted ✅allowed faded = inherited from the * wildcard group

✅GPTBot
✅ChatGPT-User
✅OAI-SearchBot
✅ClaudeBot
✅Claude-User
✅Claude-SearchBot
✅anthropic-ai
✅Claude-Web
✅CCBot
✅Google-Extended
✅Applebot-Extended
✅PerplexityBot
✅Perplexity-User
✅Bytespider
✅Amazonbot
✅FacebookBot
✅meta-externalagent
✅Meta-WebIndexer
✅meta-externalfetcher
✅cohere-ai
✅AI2Bot
✅Diffbot
✅omgili
✅YouBot
✅DuckAssistBot
✅MistralAI-User
✅PanguBot
✅Timpibot

Current robots.txt 848 bytes · sha256 1854a1f95a03 · raw 

User-agent: *
Disallow: /members/*/mem
Disallow: /-/media/Molina/PublicWebsite/PDF/
Disallow: /providers/*/duals
Disallow: /providers/*/medicare
Disallow: /providers/*/medicaid
Disallow: /marketplace/az/*
Disallow: /marketplace/ca/*
Disallow: /marketplace/fl/*
Disallow: /marketplace/ga/*
Disallow: /marketplace/ia/*
Disallow: /marketplace/id/*
Disallow: /marketplace/il/*
Disallow: /marketplace/ky/*
Disallow: /marketplace/ma/*
Disallow: /marketplace/mi/*
Disallow: /marketplace/ms/*
Disallow: /marketplace/ne/*
Disallow: /marketplace/nm/*
Disallow: /marketplace/nv/*
Disallow: /marketplace/ny/*
Disallow: /marketplace/oh/*
Disallow: /marketplace/sc/*
Disallow: /marketplace/tx/*
Disallow: /marketplace/ut/*
Disallow: /marketplace/va/*
Disallow: /marketplace/wa/*
Disallow: /marketplace/wi/*

Sitemap: https://www.molinahealthcare.com/sitemap.xml

Compare any two snapshots

Change history

  1. modified +28 −3 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /marketplace/az/* for *
    • Added Disallow: /marketplace/ca/* for *
    • Added Disallow: /marketplace/fl/* for *
    • Added Disallow: /marketplace/ga/* for *
    • … 25 more
  2. modified +3 −28 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /marketplace/az/* for *
    • Removed Disallow: /marketplace/ca/* for *
    • Removed Disallow: /marketplace/fl/* for *
    • … 25 more
  3. modified +28 −3 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /marketplace/az/* for *
    • Added Disallow: /marketplace/ca/* for *
    • Added Disallow: /marketplace/fl/* for *
    • Added Disallow: /marketplace/ga/* for *
    • … 25 more
  4. modified +3 −28 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /marketplace/az/* for *
    • Removed Disallow: /marketplace/ca/* for *
    • Removed Disallow: /marketplace/fl/* for *
    • … 25 more
  5. modified +29 −2 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /marketplace/az/* for *
    • Added Disallow: /marketplace/ca/* for *
    • Added Disallow: /marketplace/fl/* for *
    • Added Disallow: /marketplace/ga/* for *
    • … 24 more
  6. modified +2 −29 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /marketplace/az/* for *
    • Removed Disallow: /marketplace/ca/* for *
    • Removed Disallow: /marketplace/fl/* for *
    • … 24 more
  7. modified +28 −3 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /marketplace/az/* for *
    • Added Disallow: /marketplace/ca/* for *
    • Added Disallow: /marketplace/fl/* for *
    • Added Disallow: /marketplace/ga/* for *
    • … 25 more
  8. modified +3 −28 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /marketplace/az/* for *
    • Removed Disallow: /marketplace/ca/* for *
    • Removed Disallow: /marketplace/fl/* for *
    • … 25 more
  9. modified +29 −2 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /marketplace/az/* for *
    • Added Disallow: /marketplace/ca/* for *
    • Added Disallow: /marketplace/fl/* for *
    • Added Disallow: /marketplace/ga/* for *
    • … 24 more
  10. modified +0 −2 view diff → snapshot
    • Removed sitemap https://www.molinarenewyou.com/sitemap.xml
  11. modified +3 −28 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /marketplace/az/* for *
    • Removed Disallow: /marketplace/ca/* for *
    • Removed Disallow: /marketplace/fl/* for *
    • … 25 more
  12. modified +28 −3 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /marketplace/az/* for *
    • Added Disallow: /marketplace/ca/* for *
    • Added Disallow: /marketplace/fl/* for *
    • Added Disallow: /marketplace/ga/* for *
    • … 25 more
  13. modified +3 −28 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /marketplace/az/* for *
    • Removed Disallow: /marketplace/ca/* for *
    • Removed Disallow: /marketplace/fl/* for *
    • … 25 more
  14. modified +29 −2 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /marketplace/az/* for *
    • Added Disallow: /marketplace/ca/* for *
    • Added Disallow: /marketplace/fl/* for *
    • Added Disallow: /marketplace/ga/* for *
    • … 24 more
  15. modified +2 −29 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /marketplace/az/* for *
    • Removed Disallow: /marketplace/ca/* for *
    • Removed Disallow: /marketplace/fl/* for *
    • … 24 more
  16. modified +29 −2 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /marketplace/az/* for *
    • Added Disallow: /marketplace/ca/* for *
    • Added Disallow: /marketplace/fl/* for *
    • Added Disallow: /marketplace/ga/* for *
    • … 24 more
  17. modified +2 −29 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /marketplace/az/* for *
    • Removed Disallow: /marketplace/ca/* for *
    • Removed Disallow: /marketplace/fl/* for *
    • … 24 more
  18. modified +28 −3 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /marketplace/az/* for *
    • Added Disallow: /marketplace/ca/* for *
    • Added Disallow: /marketplace/fl/* for *
    • Added Disallow: /marketplace/ga/* for *
    • … 25 more
  19. modified +3 −28 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /marketplace/az/* for *
    • Removed Disallow: /marketplace/ca/* for *
    • Removed Disallow: /marketplace/fl/* for *
    • … 25 more
  20. modified +28 −3 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /marketplace/az/* for *
    • Added Disallow: /marketplace/ca/* for *
    • Added Disallow: /marketplace/fl/* for *
    • Added Disallow: /marketplace/ga/* for *
    • … 25 more
  21. modified +3 −28 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /marketplace/az/* for *
    • Removed Disallow: /marketplace/ca/* for *
    • Removed Disallow: /marketplace/fl/* for *
    • … 25 more
  22. modified +29 −2 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /marketplace/az/* for *
    • Added Disallow: /marketplace/ca/* for *
    • Added Disallow: /marketplace/fl/* for *
    • Added Disallow: /marketplace/ga/* for *
    • … 24 more
  23. modified +0 −2 view diff → snapshot
    • Removed sitemap https://www.molinamedicare.com/sitemap.xml
  24. modified +2 −0 view diff → snapshot
    • Added sitemap https://www.molinamedicare.com/sitemap.xml
  25. modified +2 −29 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /marketplace/az/* for *
    • Removed Disallow: /marketplace/ca/* for *
    • Removed Disallow: /marketplace/fl/* for *
    • … 24 more
  26. modified +29 −2 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /marketplace/az/* for *
    • Added Disallow: /marketplace/ca/* for *
    • Added Disallow: /marketplace/fl/* for *
    • Added Disallow: /marketplace/ga/* for *
    • … 24 more
  27. modified +0 −2 view diff → snapshot
    • Removed sitemap https://www.hellomolina.com/sitemap.xml
  28. modified +3 −28 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /marketplace/az/* for *
    • Removed Disallow: /marketplace/ca/* for *
    • Removed Disallow: /marketplace/fl/* for *
    • … 25 more
  29. modified +29 −2 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /marketplace/az/* for *
    • Added Disallow: /marketplace/ca/* for *
    • Added Disallow: /marketplace/fl/* for *
    • Added Disallow: /marketplace/ga/* for *
    • … 24 more
  30. modified +2 −29 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /marketplace/az/* for *
    • Removed Disallow: /marketplace/ca/* for *
    • Removed Disallow: /marketplace/fl/* for *
    • … 24 more
  31. modified +28 −3 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /marketplace/az/* for *
    • Added Disallow: /marketplace/ca/* for *
    • Added Disallow: /marketplace/fl/* for *
    • Added Disallow: /marketplace/ga/* for *
    • … 25 more
  32. modified +3 −28 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /marketplace/az/* for *
    • Removed Disallow: /marketplace/ca/* for *
    • Removed Disallow: /marketplace/fl/* for *
    • … 25 more
  33. modified +29 −2 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /marketplace/az/* for *
    • Added Disallow: /marketplace/ca/* for *
    • Added Disallow: /marketplace/fl/* for *
    • Added Disallow: /marketplace/ga/* for *
    • … 24 more
  34. modified +2 −29 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /marketplace/az/* for *
    • Removed Disallow: /marketplace/ca/* for *
    • Removed Disallow: /marketplace/fl/* for *
    • … 24 more
  35. modified +29 −2 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /marketplace/az/* for *
    • Added Disallow: /marketplace/ca/* for *
    • Added Disallow: /marketplace/fl/* for *
    • Added Disallow: /marketplace/ga/* for *
    • … 24 more
  36. modified +2 −29 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /marketplace/az/* for *
    • Removed Disallow: /marketplace/ca/* for *
    • Removed Disallow: /marketplace/fl/* for *
    • … 24 more
  37. modified +28 −3 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /marketplace/az/* for *
    • Added Disallow: /marketplace/ca/* for *
    • Added Disallow: /marketplace/fl/* for *
    • Added Disallow: /marketplace/ga/* for *
    • … 25 more
  38. modified +3 −28 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /marketplace/az/* for *
    • Removed Disallow: /marketplace/ca/* for *
    • Removed Disallow: /marketplace/fl/* for *
    • … 25 more
  39. modified +29 −2 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /marketplace/az/* for *
    • Added Disallow: /marketplace/ca/* for *
    • Added Disallow: /marketplace/fl/* for *
    • Added Disallow: /marketplace/ga/* for *
    • … 24 more
  40. modified +2 −29 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /marketplace/az/* for *
    • Removed Disallow: /marketplace/ca/* for *
    • Removed Disallow: /marketplace/fl/* for *
    • … 24 more
  41. modified +22 −0 view diff → snapshot
    • Added Disallow: /marketplace/az/* for *
    • Added Disallow: /marketplace/ca/* for *
    • Added Disallow: /marketplace/fl/* for *
    • Added Disallow: /marketplace/ga/* for *
    • Added Disallow: /marketplace/ia/* for *
    • … 17 more
  42. modified +7 −2 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /members/*/mem for *
    • Added Disallow: /providers/*/duals for *
    • Added Disallow: /providers/*/medicaid for *
    • Added Disallow: /providers/*/medicare for *
    • … 2 more
  43. modified +2 −7 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /members/*/mem for *
    • Removed Disallow: /providers/*/duals for *
    • Removed Disallow: /providers/*/medicaid for *
    • … 2 more
  44. modified +7 −2 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /members/*/mem for *
    • Added Disallow: /providers/*/duals for *
    • Added Disallow: /providers/*/medicaid for *
    • Added Disallow: /providers/*/medicare for *
    • … 2 more
  45. modified +2 −7 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /members/*/mem for *
    • Removed Disallow: /providers/*/duals for *
    • Removed Disallow: /providers/*/medicaid for *
    • … 2 more
  46. modified +7 −2 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /members/*/mem for *
    • Added Disallow: /providers/*/duals for *
    • Added Disallow: /providers/*/medicaid for *
    • Added Disallow: /providers/*/medicare for *
    • … 2 more
  47. modified +2 −7 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /members/*/mem for *
    • Removed Disallow: /providers/*/duals for *
    • Removed Disallow: /providers/*/medicaid for *
    • … 2 more
  48. modified +7 −2 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /members/*/mem for *
    • Added Disallow: /providers/*/duals for *
    • Added Disallow: /providers/*/medicaid for *
    • Added Disallow: /providers/*/medicare for *
    • … 2 more
  49. modified +2 −7 view diff → snapshot
    • Added Disallow: (empty) for *
    • Removed Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Removed Disallow: /members/*/mem for *
    • Removed Disallow: /providers/*/duals for *
    • Removed Disallow: /providers/*/medicaid for *
    • … 2 more
  50. modified +5 −2 view diff → snapshot
    • Added Disallow: /-/media/Molina/PublicWebsite/PDF/ for *
    • Added Disallow: /members/*/mem for *
    • Added Disallow: /providers/*/duals for *
    • Added Disallow: /providers/*/medicaid for *
    • Added Disallow: /providers/*/medicare for *
    • … 1 more
  51. modified +2 −0 view diff → snapshot
    • Added sitemap https://www.molinahealthcare.com/sitemap.xml
  52. modified +0 −2 view diff → snapshot
    • Removed sitemap https://www.molinahealthcare.com/sitemap.xml
  53. modified +2 −0 view diff → snapshot
    • Added sitemap https://www.molinahealthcare.com/sitemap.xml
  54. modified +0 −2 view diff → snapshot
    • Removed sitemap https://www.molinahealthcare.com/sitemap.xml
  55. modified +2 −0 view diff → snapshot
    • Added sitemap https://www.molinahealthcare.com/sitemap.xml
  56. modified +0 −2 view diff → snapshot
    • Removed sitemap https://www.molinahealthcare.com/sitemap.xml
  57. modified +1 −1 view diff → snapshot
    • Formatting/comment-only change (no semantic difference)
  58. initial snapshot
    • First snapshot of robots.txt archived