🇺🇸 McAfee
mcafee.com · Cybersecurity · rank #54 · Cybersecurity · live robots.txt ↗
AI crawler access (latest snapshot, 5h ago)
⛔blocked
restricted
✅allowed
faded = inherited from the * wildcard group
✅GPTBot
✅ChatGPT-User
✅OAI-SearchBot
✅ClaudeBot
✅Claude-User
✅Claude-SearchBot
✅anthropic-ai
✅Claude-Web
✅CCBot
✅Google-Extended
✅Applebot-Extended
✅PerplexityBot
✅Perplexity-User
✅Bytespider
✅Amazonbot
✅FacebookBot
✅meta-externalagent
✅meta-externalfetcher
✅cohere-ai
✅AI2Bot
✅Diffbot
✅omgili
✅YouBot
✅DuckAssistBot
✅MistralAI-User
✅PanguBot
✅Timpibot
Current robots.txt 3323 bytes · sha256 d05fa36db84c · raw
# directory exclusion used for mcafee.com user-agent: * # # ########################################################## #Consumer Sitemap Starts ########################################################## Sitemap: https://www.mcafee.com/content/dam/npcld/ecommerce/site-config/main-sitemap-index.xml Sitemap: https://www.mcafee.com/content/dam/npcld/ecommerce/site-config/corp-sitemap-index.xml Sitemap: https://www.mcafee.com/learn/sitemap_index.xml Sitemap: https://www.mcafee.com/blogs/sitemap_index.xml Sitemap: https://www.mcafee.com/support/s/sitemap.xml ########################################################## #Consumer Sitemap Ends ########################################################## ########################################################## #Consumer ########################################################## # 2024-02-06T11:52:52.760 # Applicable to all cultures Disallow: /consumer/*/promos Disallow: /consumer/*/support Disallow: /consumer/*/legal Disallow: /*/ipz/* Disallow: /consumer/*/referenced-content Disallow: /consumer/*/policy-referenced-content Disallow: /consumer/*/site-configurations Disallow: /consumer/*/InternalServerError Disallow: /consumer/*/403 Disallow: /consumer/*/404 Disallow: /consumer/*/VoucherredemptionEnd Disallow: /consumer/*/store/ Disallow: /consumer/*/pstore Disallow: /consumer/*/microsite Disallow: /*/jcr:content/* Disallow: /*?path= # Restrictions per culture Disallow: /consumer/en-ca1 Disallow: /consumer/sitemap Disallow: /consumer/sr-rs # Stop Google from crawling URLs with the news_id parameter, except for the press releases, which are fine to crawl Disallow: /*?news_id= Allow: /*/press-release.html?news_id= # Stop Google from crawling URLs with these parameters Disallow: /?dve_trk_id Disallow: /?v= Disallow: /*?ref= Disallow: /*?wcmmode= Disallow: /*?pkgCode= Disallow: /*?moguid= ########################################################## # Consumer Ends ########################################################## ########################################################## #Support Starts ########################################################## Disallow: /support/remote Disallow: /support/refund Disallow: /support/reimburserequest Disallow: /support/pop Disallow: /support/purchaseproof Disallow: /support/autorenewal Disallow: /support/mcafeesecurity Disallow: /support/rr Disallow: /support/idtp Disallow: /support/restorationhelp Disallow: /support/requestrefund Disallow: /support/techmaster Disallow: /support/business Disallow: /support/getstarted Disallow: /support/cyberscamswps Disallow: /support/restore Disallow: /support/gst Disallow: /support/s/remote Disallow: /support/s/refund Disallow: /support/s/reimburserequest Disallow: /support/s/pop Disallow: /support/s/purchaseproof Disallow: /support/s/autorenewal Disallow: /support/s/mcafeesecurity Disallow: /support/s/rr Disallow: /support/s/idtp Disallow: /support/s/restorationhelp Disallow: /support/s/requestrefund Disallow: /support/s/techmaster Disallow: /support/s/business Disallow: /support/s/getstarted Disallow: /support/s/cyberscamswps Disallow: /support/s/restore Disallow: /support/s/gst Disallow: /support/s/mobilesupport ########################################################## #Support Ends ##########################################################
Change history
-
initial snapshot
- First snapshot of robots.txt archived