NeuralCrawl

StoneX Group / robots.txt snapshot

← back to stonex.com · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 1675 bytes · sha256 a8ce44f204522efc · raw

final URL: https://www.stonex.com/robots.txt

1User-agent: *
2Disallow: /lp/
3Disallow: /bin/
4Disallow: /xsl/
5Disallow: /temp
6Disallow: /error
7Disallow: /Views/
8Disallow: /media/
9Disallow: /static
10Disallow: /upload
11Disallow: /en/lp/
12Disallow: /en/bin/
13Disallow: /en/xsl/
14Disallow: /en/temp
15Disallow: /cgi-bin/
16Disallow: /en/error
17Disallow: /cdn-cgi/
18Disallow: /sitecore/
19Disallow: /App_Data/
20Disallow: /info.html
21Disallow: /not-found
22Disallow: /Artifacts
23Disallow: /en/Views/
24Disallow: /en/media/
25Disallow: /en/static
26Disallow: /en/upload
27Disallow: /*?*market=
28Disallow: */sitecore/
29Disallow: /*/patterns/
30Disallow: /App_config/
31Disallow: /health.aspx
32Disallow: /*?*pagenum=
33Disallow: /en/cgi-bin/
34Disallow: /Default.aspx
35Disallow: /en/App_Data/
36Disallow: /en/info.html
37Disallow: /en/not-found
38Disallow: /en/Artifacts
39Disallow: /App_Browsers/
40Disallow: /en/*?*market=
41Disallow: /en/App_config/
42Disallow: /en/health.aspx
43Disallow: /en/*?*pagenum=
44Disallow: /sitecore_files/
45Disallow: /en/Default.aspx
46Disallow: /en/App_Browsers/
47Disallow: */sitecore_files/
48Disallow: /sitecore modules/
49Disallow: /search-results/?q*
50Disallow: */sitecore modules/
51Disallow: /en/search-results/?q*
52Disallow: /websites-in-maintenance.aspx
53Disallow: /en/websites-in-maintenance.aspx
54
55Sitemap: https://www.stonex.com/sitemap.xml
56Sitemap: https://www.stonex.com/en/sitemap.xml
57Sitemap: https://www.stonex.com/pt-br/sitemap.xml
58Sitemap: https://www.stonex.com/es-ar/sitemap.xml
59Sitemap: https://www.stonex.com/ja-jp/sitemap.xml
60Sitemap: https://www.stonex.com/en/sitemap-index.xml
61Sitemap: https://www.stonex.com/pt-br/sitemap-index.xml
62Sitemap: https://www.stonex.com/en-us/sitemap-index.xml
63Sitemap: https://www.stonex.com/en-gb/sitemap-index.xml