NeuralCrawl

StoneX Group / robots.txt snapshot

← back to stonex.com · fetched 2026-11-05T13:47:51Z (2d ago) · HTTP 200 · 1624 bytes · sha256 6750bbf5b935eca3 · raw

final URL: https://www.stonex.com/robots.txt

1User-Agent: *
2Disallow: /*/lp/
3Disallow: /*/bin/
4Disallow: /*/xsl/
5Disallow: /*/temp/
6Disallow: /*/error/
7Disallow: /Views/
8Disallow: /static
9Disallow: /upload
10Disallow: /cgi-bin/
11Disallow: /cdn-cgi/
12Disallow: /sitecore/
13Disallow: /App_Data/
14Disallow: /info.html
15Disallow: /not-found
16Disallow: /Artifacts
17Disallow: /en/Views/
18Disallow: /en/media/
19Disallow: /en/static
20Disallow: /en/upload
21Disallow: /*?*market=
22Disallow: /*/sitecore/
23Disallow: /*/patterns/
24Disallow: /App_config/
25Disallow: /health.aspx
26Disallow: /*?*pagenum=
27Disallow: /en/cgi-bin/
28Disallow: /Default.aspx
29Disallow: /en/App_Data/
30Disallow: /en/info.html
31Disallow: /en/not-found
32Disallow: /en/Artifacts
33Disallow: /App_Browsers/
34Disallow: /en/*?*market=
35Disallow: /en/App_config/
36Disallow: /en/health.aspx
37Disallow: /en/*?*pagenum=
38Disallow: /sitecore_files/
39Disallow: /en/Default.aspx
40Disallow: /en/App_Browsers/
41Disallow: /*/sitecore_files/
42Disallow: /search-results/?q*
43Disallow: /*/sitecore modules
44Disallow: /en/search-results/?q*
45Disallow: /websites-in-maintenance.aspx
46Disallow: /en/websites-in-maintenance.aspx
47Disallow: /*/search/?query=
48Disallow: /api/barchart-widget/
49Disallow: /layouts/
50Disallow: /*.aspx
51Disallow: /*.php
52Disallow: /*.map
53Disallow: /*/?_rsc=
54
55Sitemap: https://www.stonex.com/en-us/sitemap-b2b.xml
56Sitemap: https://www.stonex.com/en/sitemap-index.xml
57Sitemap: https://www.stonex.com/en-us/sitemap-index.xml
58Sitemap: https://www.stonex.com/en-gb/sitemap-index.xml
59Sitemap: https://www.stonex.com/pt-br/sitemap-index.xml
60Sitemap: https://www.stonex.com/ja-jp/sitemap-index.xml
61Sitemap: https://www.stonex.com/es-ar/sitemap-index.xml