Cybersecurity
The archive — every monitored site, its robots.txt history and AI-crawler stance.
All sites
Top 1000 websites
US 500
Nasdaq 100
AI models
Cybersecurity
SEO & AI search
Creative rights-holders
Knowledge & UGC
Academic & open research
Universities
National indices
Banks & fintech
E-commerce
European companies
Social Networks
Governments
Publishers
| # | Company | Domain | Sector | robots.txt | AI bots blocked | Snapshots | Changes | Last change | |
|---|---|---|---|---|---|---|---|---|---|
| 1 | 🇺🇸 | Palo Alto Networks |
|
Technology | present | 0 | 2 | 1 | 4mo ago |
| 2 | 🇺🇸 | CrowdStrike |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 3 | 🇺🇸 | Fortinet |
|
Cybersecurity | present | 🤖 1 | 2 | 1 | 2mo ago |
| 4 | 🇺🇸 | Cloudflare |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 5 | 🇺🇸 | Zscaler |
|
Cybersecurity | present | 0 | 4 | 3 | 1mo ago |
| 6 | 🇺🇸 | Okta |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 7 | 🇺🇸 | SentinelOne |
|
Cybersecurity | present | 0 | 3 | 2 | 1d ago |
| 8 | 🇺🇸 | CyberArk |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 9 | 🇺🇸 | Cisco Systems |
|
Technology | present | 0 | 2 | 1 | 21d ago |
| 10 | 🇺🇸 | Broadcom |
|
Technology | present | 0 | 1 | 0 | — |
| 11 | 🇺🇸 | Akamai Technologies |
akamai.com
|
Technology | present | 0 | 1 | 0 | — |
| 12 | 🇺🇸 | Splunk |
|
Cybersecurity | present | 0 | 2 | 1 | 1mo ago |
| 13 | 🇺🇸 | Qualys |
|
Cybersecurity | present | 0 | 2 | 1 | 5d ago |
| 14 | 🇺🇸 | Tenable |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 15 | 🇺🇸 | Rapid7 |
|
Cybersecurity | present | 0 | 2 | 1 | 3mo ago |
| 16 | 🇺🇸 | Proofpoint |
|
Cybersecurity | present | 🤖 4 | 31 | 30 | 17h ago |
| 17 | 🇺🇸 | Mimecast |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 18 | 🇺🇸 | Netskope |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 19 | 🇺🇸 | Varonis |
|
Cybersecurity | present | 0 | 9 | 8 | 11h ago |
| 20 | 🇺🇸 | Mandiant |
|
Cybersecurity | redirect | 0 | 0 | 0 | — |
| 21 | 🇺🇸 | Gen Digital |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 22 | 🇺🇸 | Rubrik |
|
Cybersecurity | present | 0 | 3 | 2 | 1d ago |
| 23 | 🇺🇸 | Tanium |
|
Cybersecurity | present | 0 | 3 | 2 | 2mo ago |
| 24 | 🇺🇸 | Wiz |
|
Cybersecurity | present | 0 | 3 | 2 | 1mo ago |
| 25 | 🇺🇸 | Snyk |
|
Cybersecurity | present | 0 | 5 | 4 | 15d ago |
| 26 | 🇺🇸 | Orca Security |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 27 | 🇺🇸 | Cohesity |
|
Cybersecurity | present | 0 | 3 | 2 | 1mo ago |
| 28 | 🇺🇸 | Fortra |
|
Cybersecurity | present | 0 | 5 | 4 | 1mo ago |
| 29 | 🇺🇸 | HashiCorp |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 30 | 🇺🇸 | OneTrust |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 31 | 🇺🇸 | Arctic Wolf |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 32 | 🇺🇸 | Dragos |
|
Cybersecurity | present | 0 | 2 | 1 | 10d ago |
| 33 | 🇺🇸 | Recorded Future |
|
Cybersecurity | present | 0 | 2 | 1 | 4mo ago |
| 34 | 🇺🇸 | Barracuda |
|
Cybersecurity | present | 0 | 18 | 32 | 16d ago |
| 35 | 🇺🇸 | Zimperium |
|
Cybersecurity | present | 0 | 3 | 2 | 2mo ago |
| 36 | 🇺🇸 | Lookout |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 37 | 🇮🇱 | Check Point |
|
Technology | present | 0 | 3 | 2 | 1mo ago |
| 38 | 🇬🇧 | Darktrace |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 39 | 🇬🇧 | Sophos |
|
Cybersecurity | present | 🤖 1 | 2 | 1 | 17d ago |
| 40 | 🇯🇵 | Trend Micro |
|
Cybersecurity | present | 0 | 2 | 1 | 4mo ago |
| 41 | 🇸🇰 | ESET |
|
Cybersecurity | present | 0 | 3 | 2 | 1d ago |
| 42 | 🇫🇮 | WithSecure |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 43 | 🇷🇴 | Bitdefender |
|
Cybersecurity | present | 0 | 4 | 3 | 29d ago |
| 44 | 🇨🇭 | Kaspersky |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 45 | 🇺🇸 | Illumio |
|
Cybersecurity | present | 0 | 2 | 1 | 3mo ago |
| 46 | 🇺🇸 | Human Security |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 47 | 🇫🇷 | DataDome |
|
Cybersecurity | present | 0 | 2 | 1 | 4mo ago |
| 48 | 🇺🇸 | Malwarebytes |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 49 | 🇺🇸 | Imperva |
|
Cybersecurity | present | 0 | 2 | 1 | 3mo ago |
| 50 | 🇺🇸 | F5 |
|
Cybersecurity | present | 0 | 5 | 5 | 2mo ago |
| 51 | 🇦🇺 | Kasada |
|
Cybersecurity | present | 0 | 2 | 1 | 3mo ago |
| 52 | 🇺🇸 | Arkose Labs |
|
Cybersecurity | present | 🤖 1 | 5 | 4 | 1mo ago |
| 53 | 🇨🇿 | Avast |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 54 | 🇺🇸 | McAfee |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 55 | 🇺🇸 | Vectra AI |
|
Cybersecurity | present | 0 | 1 | 0 | — |
| 56 | 🇺🇸 | ExtraHop |
|
Cybersecurity | present | 0 | 2 | 1 | 2mo ago |