SentinelOne / robots.txt
← back to sentinelone.com · change detected 14d ago (2026-10-23T21:25:10Z) · modified +16 −19
What changed
- Added Allow: / for *
- Added Disallow: /api/ for *
- Added sitemap https://www.sentinelone.com/de/sitemap-index.xml
- Added sitemap https://www.sentinelone.com/es/sitemap-index.xml
- Added sitemap https://www.sentinelone.com/fr/sitemap-index.xml
- Added sitemap https://www.sentinelone.com/it/sitemap-index.xml
- Added sitemap https://www.sentinelone.com/ja/sitemap-index.xml
- Added sitemap https://www.sentinelone.com/ko/sitemap-index.xml
- Added sitemap https://www.sentinelone.com/nl/sitemap-index.xml
- Added sitemap https://www.sentinelone.com/sitemap-index.xml
- Added sitemap https://www.sentinelone.com/tw/sitemap-index.xml
- Removed sitemap https://www.sentinelone.com/de/sitemap_index.xml
- Removed sitemap https://www.sentinelone.com/es/sitemap_index.xml
- Removed sitemap https://www.sentinelone.com/fr/sitemap_index.xml
- Removed sitemap https://www.sentinelone.com/it/sitemap_index.xml
- Removed sitemap https://www.sentinelone.com/ja/sitemap_index.xml
- Removed sitemap https://www.sentinelone.com/ko/sitemap_index.xml
- Removed sitemap https://www.sentinelone.com/nl/sitemap_index.xml
- Removed sitemap https://www.sentinelone.com/sitemap_index.xml
Diff old (2026-06-20T14:27:25Z) → new (2026-10-23T21:25:10Z)
| @@ -1,28 +1,25 @@ | ||
| 1 | - User-agent: * | |
| 1 | + User-Agent: * | |
| 2 | + Allow: / | |
| 3 | + Allow: /wp-admin/admin-ajax.php | |
| 4 | + Allow: /resources/?* | |
| 5 | + Disallow: /api/ | |
| 2 | 6 | Disallow: /wp-admin/ |
| 3 | - Allow: /wp-admin/admin-ajax.php | |
| 4 | 7 | Disallow: /*?* |
| 5 | - Allow: /resources/?* | |
| 6 | 8 | Disallow: *.pdf$ |
| 7 | 9 | Disallow: /static/lp/s1-value-app-2024/ |
| 8 | 10 | |
| 9 | - | |
| 10 | - # Google News-specific exclusion | |
| 11 | - User-agent: Googlebot-News | |
| 12 | - Disallow: / | |
| 11 | + User-Agent: Googlebot-News | |
| 13 | 12 | Allow: /press/ |
| 14 | 13 | Allow: /blog/ |
| 14 | + Disallow: / | |
| 15 | 15 | |
| 16 | - | |
| 17 | - # Sitemap Indexes | |
| 18 | - Sitemap: https://www.sentinelone.com/sitemap_index.xml | |
| 19 | - Sitemap: https://www.sentinelone.com/nl/sitemap_index.xml | |
| 20 | - Sitemap: https://www.sentinelone.com/de/sitemap_index.xml | |
| 21 | - Sitemap: https://www.sentinelone.com/es/sitemap_index.xml | |
| 22 | - Sitemap: https://www.sentinelone.com/it/sitemap_index.xml | |
| 23 | - Sitemap: https://www.sentinelone.com/fr/sitemap_index.xml | |
| 24 | - Sitemap: https://www.sentinelone.com/ja/sitemap_index.xml | |
| 25 | - Sitemap: https://www.sentinelone.com/ko/sitemap_index.xml | |
| 26 | - | |
| 27 | - # CVE DB | |
| 16 | + Sitemap: https://www.sentinelone.com/sitemap-index.xml | |
| 17 | + Sitemap: https://www.sentinelone.com/de/sitemap-index.xml | |
| 18 | + Sitemap: https://www.sentinelone.com/fr/sitemap-index.xml | |
| 19 | + Sitemap: https://www.sentinelone.com/es/sitemap-index.xml | |
| 20 | + Sitemap: https://www.sentinelone.com/it/sitemap-index.xml | |
| 21 | + Sitemap: https://www.sentinelone.com/ja/sitemap-index.xml | |
| 22 | + Sitemap: https://www.sentinelone.com/ko/sitemap-index.xml | |
| 23 | + Sitemap: https://www.sentinelone.com/nl/sitemap-index.xml | |
| 24 | + Sitemap: https://www.sentinelone.com/tw/sitemap-index.xml | |
| 28 | 25 | Sitemap: https://www.sentinelone.com/cve-sitemaps/index.xml |