NeuralCrawl

๐Ÿ‡ณ๐Ÿ‡ฑ KPN

kpn.com · European companies · rank #129 · Telecommunications · live robots.txt ↗

AI crawler access (latest snapshot, 13h ago)

blocked restricted allowed faded = inherited from the * wildcard group

GPTBot
ChatGPT-User
OAI-SearchBot
ClaudeBot
Claude-User
Claude-SearchBot
anthropic-ai
Claude-Web
CCBot
Google-Extended
Applebot-Extended
PerplexityBot
Perplexity-User
Bytespider
Amazonbot
FacebookBot
meta-externalagent
meta-externalfetcher
cohere-ai
AI2Bot
Diffbot
omgili
YouBot
DuckAssistBot
MistralAI-User
PanguBot
Timpibot

Current robots.txt 784 bytes · sha256 4e12e3a8fe95 · raw

User-Agent: *
Allow: /
Allow: /shop/api/*
Disallow: /kpn/restricted
Disallow: /mailinfo
Disallow: /mailinfo.htm
Disallow: /prive/pakketten-oud
Disallow: /web
Disallow: */api/*
Disallow: /w3/rest/*
Disallow: /w3/file*
Disallow: /kpnehpsp/
Disallow: /testpages/*
Disallow: /tstpages/*
Disallow: /ss/*
Disallow: */appd-endpoint/
Disallow: */appd-static/
Disallow: /v2/*
Disallow: /w3/vind-een-winkel/winkel-niet-gevonden
Disallow: /kpn-faq/*
Disallow: /service/mobiel/problemen/toestelhulp*
Disallow: /zakelijk/thedigitaldutch/auteur.htm
Disallow: /zakelijk/thedigitaldutch/auteur/*
Disallow: /user-guidance-display-on-page/*
Disallow: *.htm?channel=mobile
Disallow: /internet/glasvezel/plaatsen/bekijk-en-vergelijk-glasvezel-internet.htm

Sitemap: https://www.kpn.com/sitemap_index.xml

Change history

  1. initial snapshot
    • First snapshot of robots.txt archived