NeuralCrawl

SentinelOne / robots.txt snapshot

← back to sentinelone.com · fetched 2026-10-23T21:25:10Z (14d ago) · HTTP 200 · 834 bytes · sha256 e61a4689ddec207f · raw

final URL: https://www.sentinelone.com/robots.txt

1User-Agent: *
2Allow: /
3Allow: /wp-admin/admin-ajax.php
4Allow: /resources/?*
5Disallow: /api/
6Disallow: /wp-admin/
7Disallow: /*?*
8Disallow: *.pdf$
9Disallow: /static/lp/s1-value-app-2024/
10
11User-Agent: Googlebot-News
12Allow: /press/
13Allow: /blog/
14Disallow: /
15
16Sitemap: https://www.sentinelone.com/sitemap-index.xml
17Sitemap: https://www.sentinelone.com/de/sitemap-index.xml
18Sitemap: https://www.sentinelone.com/fr/sitemap-index.xml
19Sitemap: https://www.sentinelone.com/es/sitemap-index.xml
20Sitemap: https://www.sentinelone.com/it/sitemap-index.xml
21Sitemap: https://www.sentinelone.com/ja/sitemap-index.xml
22Sitemap: https://www.sentinelone.com/ko/sitemap-index.xml
23Sitemap: https://www.sentinelone.com/nl/sitemap-index.xml
24Sitemap: https://www.sentinelone.com/tw/sitemap-index.xml
25Sitemap: https://www.sentinelone.com/cve-sitemaps/index.xml