NeuralCrawl

Pure Storage / robots.txt snapshot

← back to purestorage.com · fetched 2026-06-20T01:10:31Z (18h ago) · HTTP 200 · 1308 bytes · sha256 e6c866214d5dcc0e · raw

final URL: https://www.everpuredata.com/robots.txt

1#
2# ALL SPIDERS
3#
4User-Agent: *
5Disallow:
6Disallow: /refs/
7Disallow: /samples/
8Disallow: /company/events/special-events/
9Disallow: /*content/dam/purestorage/pdf/us-pricelist.pdf*
10Disallow: /*content/dam/pdf/en/misc/awarded-cmas-3-18-70-3113D-fully-executed.pdf*
11Disallow: /*content/dam/pdf/en/misc/cmas-pure-resellers%203-18-70-3113D.pdf*
12Disallow: /*content/dam/purestorage/pdf/us-pricelist-aug-2018-nc-204x.pdf*
13Disallow: /*content/dam/purestorage/pdf/active-partners-nc-204x.pdf*
14Disallow: /*content/dam/purestorage/pdf/gsa-partners-for-pure-storage.pdf*
15Disallow: /*content/dam/purestorage/pdf/us-pricelist.pdf*
16Disallow: /*content/dam/pdf/en/misc/state-of-georgia-contract.pdf*
17Disallow: /*content/dam/pdf/en/misc/state-of-georgia-pricelist.pdf*
18Disallow: /*content/dam/pdf/en/misc/state-of-georgia-ordering-information.pdf*
19Disallow: /*content/dam/purestorage/pdf/nys-ogs-pricelist.pdf*
20Disallow: /*content/dam/pdf/en/legal/nys-ogs-reseller-information.pdf*
21
22Disallow: /*search-results.html*
23Disallow: /*?utm*
24Disallow: /*marketoLeadQueue.*
25Disallow: /*content/dam/purestorage/pdf/*/protected/*.pdf*
26Disallow: /*content/dam/pdf/*/protected/*.pdf*
27
28#
29# Sitemaps
30#
31Sitemap: https://www.everpuredata.com/sitemap_index.xml
32
33User-agent: AhrefsBot
34Crawl-delay: 5
35
36User-agent: AhrefsSiteAudit
37Crawl-delay: 5