NeuralCrawl

SentinelOne / robots.txt snapshot

← back to sentinelone.com · fetched 2026-06-20T14:27:25Z (7h ago) · HTTP 200 · 814 bytes · sha256 beb5d1a712e50af3 · raw

final URL: https://sentinelone.com/robots.txt

1User-agent: *
2Disallow: /wp-admin/
3Allow: /wp-admin/admin-ajax.php
4Disallow: /*?*
5Allow: /resources/?*
6Disallow: *.pdf$
7Disallow: /static/lp/s1-value-app-2024/
8
9
10# Google News-specific exclusion
11User-agent: Googlebot-News
12Disallow: /
13Allow: /press/
14Allow: /blog/
15
16
17# Sitemap Indexes
18Sitemap: https://www.sentinelone.com/sitemap_index.xml
19Sitemap: https://www.sentinelone.com/nl/sitemap_index.xml
20Sitemap: https://www.sentinelone.com/de/sitemap_index.xml
21Sitemap: https://www.sentinelone.com/es/sitemap_index.xml
22Sitemap: https://www.sentinelone.com/it/sitemap_index.xml
23Sitemap: https://www.sentinelone.com/fr/sitemap_index.xml
24Sitemap: https://www.sentinelone.com/ja/sitemap_index.xml
25Sitemap: https://www.sentinelone.com/ko/sitemap_index.xml
26
27# CVE DB
28Sitemap: https://www.sentinelone.com/cve-sitemaps/index.xml