NeuralCrawl

๐Ÿ‡ฉ๐Ÿ‡ช Porsche

porsche.com · European companies · rank #90 · Motor Vehicles · live robots.txt ↗

AI crawler access (latest snapshot, 13h ago)

blocked restricted allowed faded = inherited from the * wildcard group

GPTBot
ChatGPT-User
OAI-SearchBot
ClaudeBot
Claude-User
Claude-SearchBot
anthropic-ai
Claude-Web
CCBot
Google-Extended
Applebot-Extended
PerplexityBot
Perplexity-User
Bytespider
Amazonbot
FacebookBot
meta-externalagent
meta-externalfetcher
cohere-ai
AI2Bot
Diffbot
omgili
YouBot
DuckAssistBot
MistralAI-User
PanguBot
Timpibot

Current robots.txt 4552 bytes · sha256 1e5d7137ea90 · raw

User-agent: *
Disallow:/api/
Disallow:/*/login/
Disallow:/search/
Disallow:/*/search/
Disallow:/exit/
Disallow:/SRTO_SLA_test_files/
Disallow:/pcclb/
Disallow:/germany/accessoriesandservices/porsche-calendar-2018/
Disallow:/all/media/flash/classic/book2/en-uk/
Disallow:/measure/
Disallow:/all/chatbotprototype_dealer/
Disallow:/prototype-static/

Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/2014/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/2013/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/archive2012/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/overview2011/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/overview2010/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/overview2009/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/archive2008/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/archive2007/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/archive2006/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/archive2005/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/archive2004/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/archive2003/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/issue404/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/issue405/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/403/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/402/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/401/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/400/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/399/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/398/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/397/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/396/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/395/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/393/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/392/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/391/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/390/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/389/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/388/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/387/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/386/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/385/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/384/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/383/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/382/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/381/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/380/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/379/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/378/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/377/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/376/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/375/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/374/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/373/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/372/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/371/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/370/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/369/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/368/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/367/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/366/
Disallow:/netherlands/nl/aboutporsche/christophorusmagazine/archive/

User-agent: EmailCollector
Disallow: /

User-agent: sitecheck.internetseer.com
Disallow: /

User-agent: Zealbot
Disallow: /

User-agent: MSIECrawler
Disallow: /

User-agent: SiteSnagger
Disallow: /

User-agent: WebStripper
Disallow: /

User-agent: WebCopier
Disallow: /

Sitemap: https://www.porsche.com/sitemap.xml

Change history

  1. initial snapshot
    • First snapshot of robots.txt archived