🇨🇭 Kaspersky

kaspersky.com · Cybersecurity · rank #44 · Cybersecurity · live robots.txt ↗

AI crawler access (latest snapshot, 5h ago)

⛔blocked restricted ✅allowed faded = inherited from the * wildcard group

✅GPTBot

✅ChatGPT-User

✅OAI-SearchBot

✅ClaudeBot

✅Claude-User

✅Claude-SearchBot

✅anthropic-ai

✅Claude-Web

✅CCBot

✅Google-Extended

✅Applebot-Extended

✅PerplexityBot

✅Perplexity-User

✅Bytespider

✅Amazonbot

✅FacebookBot

✅meta-externalagent

✅meta-externalfetcher

✅cohere-ai

✅AI2Bot

✅Diffbot

✅omgili

✅YouBot

✅DuckAssistBot

✅MistralAI-User

✅PanguBot

✅Timpibot

Current robots.txt 1930 bytes · sha256 bd1a53def45e · raw

Sitemap: https://www.kaspersky.com/sitemap.xml
Sitemap: https://www.kaspersky.com/blog/sitemap.xml

User-agent: *
Allow: /lp/vpn-comparison
Disallow: /acq/
Disallow: /search
Disallow: /rss-feeds
Disallow: /components/
Disallow: /b2c-tools/
Disallow: /entp/
Disallow: /feeds/
Disallow: /lp/
Disallow: /go/
Disallow: /_svc/
Disallow: /embed/
Disallow: /?slow=*
Disallow: /n/
Disallow: /wiki-section/feedback
Disallow: /templates/site-header_main-nav.html
Disallow: /templates/site-header_mega-menu__b2c.html
Disallow: /templates/site-header_mega-menu__res.html
Disallow: /resources/template/
Disallow: /renewal-center/
Disallow: /?serial=*
Disallow: *.json
Disallow: */thank-you
Disallow: /Date

Allow: /.well-known/amphtml/apikey.pub
Allow: /renewal-center/home
Allow: /renewal-center/business

Clean-param: _ga&source_caller&c&shortlink&reseller&erid&downlink&cid&redef&icid&referer1&referer2&slow&campaign&bvrrp&ga_&omreferrer&attachment_id&bid&pid&data1&sort&pn&pcn&slowsnav&sn&csn&time&id&chapter&partnerid&qid&acity&cregion&blocknum2&openform&thru&inp&THRU&ac&act-item&kaspr&etext&domain&n&sub


# ---- OPENAI ----
User-agent: OAI-SearchBot
Allow: /

# ---- ChatGPT ---- 
User-agent: ChatGPT-User
Allow: /
User-agent: GPTBot
Allow: /                     

# ---- Claude ----
User-agent: ClaudeBot         
Allow: /
User-agent: claude-web       
Allow: /
User-agent: Claude-User
Allow: /

# ---- PERPLEXITY ----
User-agent: PerplexityBot     
Allow: /
User-agent: Perplexity-User   
Allow: /

# ---- GOOGLE (Gemini) ----
User-agent: Google-Extended
Allow: /

# ---- APPLE ----
User-agent: Applebot
Allow: /
User-agent: Applebot-Extended
Allow: /

# ---- DUCKDUCKGO ----
User-agent: DuckAssistBot
Allow: /

# ---- COMMON CRAWL ----
User-agent: CCBot
Allow: /
User-agent: Diffbot
Allow: /

# ---- Others ----
User-agent: MistralAI-User 
Allow: /
User-agent: YouBot
Allow: /

# ---- Deepseek ----
User-agent: DeepSeekBot
Allow: /

Change history

initial 5h ago snapshot
- First snapshot of robots.txt archived