NeuralCrawl

Rockwell Automation / robots.txt snapshot

← back to rockwellautomation.com · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 6213 bytes · sha256 d3f7a9d575466a8f · raw

final URL: https://www.rockwellautomation.com/robots.txt

1# robots.txt for https://www.rockwellautomation.com for Prod only
2
3User-agent: *
4Disallow: /content/_cq_tags
5Disallow: /content/rockwell-automation/style-guide
6Disallow: /content/rockwell-automation/language-masters
7Disallow: /content/rockwell-automation/global
8Disallow: /*jcr:content*
9
10# eCommerce
11Disallow: */ecommerce
12
13# North America
14Sitemap: https://www.rockwellautomation.com/en-us/sitemapindex.xml
15Sitemap: https://www.rockwellautomation.com/en-ca/sitemapindex.xml
16Sitemap: https://www.rockwellautomation.com/fr-ca/sitemapindex.xml
17
18# Europe, the Middle East, Africa
19Sitemap: https://www.rockwellautomation.com/en-dk/sitemapindex.xml
20Sitemap: https://www.rockwellautomation.com/en-fi/sitemapindex.xml
21Sitemap: https://www.rockwellautomation.com/en-hu/sitemapindex.xml
22Sitemap: https://www.rockwellautomation.com/en-ie/sitemapindex.xml
23Sitemap: https://www.rockwellautomation.com/en-il/sitemapindex.xml
24Sitemap: https://www.rockwellautomation.com/en-no/sitemapindex.xml
25Sitemap: https://www.rockwellautomation.com/en-ro/sitemapindex.xml
26Sitemap: https://www.rockwellautomation.com/en-gb/sitemapindex.xml
27Sitemap: https://www.rockwellautomation.com/en-ua/sitemapindex.xml
28Sitemap: https://www.rockwellautomation.com/en-za/sitemapindex.xml
29Sitemap: https://www.rockwellautomation.com/en-pl/sitemapindex.xml
30Sitemap: https://www.rockwellautomation.com/en-tr/sitemapindex.xml
31Sitemap: https://www.rockwellautomation.com/en-ru/sitemapindex.xml
32Sitemap: https://www.rockwellautomation.com/en-se/sitemapindex.xml
33Sitemap: https://www.rockwellautomation.com/en-cz/sitemapindex.xml
34Sitemap: https://www.rockwellautomation.com/en-be/sitemapindex.xml
35Sitemap: https://www.rockwellautomation.com/en-nl/sitemapindex.xml
36Sitemap: https://www.rockwellautomation.com/en-mde/sitemapindex.xml
37Sitemap: https://www.rockwellautomation.com/de-de/sitemapindex.xml
38Sitemap: https://www.rockwellautomation.com/de-at/sitemapindex.xml
39Sitemap: https://www.rockwellautomation.com/de-ch/sitemapindex.xml
40Sitemap: https://www.rockwellautomation.com/es-es/sitemapindex.xml
41Sitemap: https://www.rockwellautomation.com/fr-fr/sitemapindex.xml
42Sitemap: https://www.rockwellautomation.com/fr-be/sitemapindex.xml
43Sitemap: https://www.rockwellautomation.com/fr-ch/sitemapindex.xml
44Sitemap: https://www.rockwellautomation.com/it-it/sitemapindex.xml
45Sitemap: https://www.rockwellautomation.com/pt-pt/sitemapindex.xml
46
47# Latin America
48Sitemap: https://www.rockwellautomation.com/en-pr/sitemapindex.xml
49Sitemap: https://www.rockwellautomation.com/es-pr/sitemapindex.xml
50Sitemap: https://www.rockwellautomation.com/es-mx/sitemapindex.xml
51Sitemap: https://www.rockwellautomation.com/es-ar/sitemapindex.xml
52Sitemap: https://www.rockwellautomation.com/es-co/sitemapindex.xml
53Sitemap: https://www.rockwellautomation.com/pt-br/sitemapindex.xml
54
55# Asia-Pacific
56Sitemap: https://www.rockwellautomation.com/en-au/sitemapindex.xml
57Sitemap: https://www.rockwellautomation.com/en-nz/sitemapindex.xml
58Sitemap: https://www.rockwellautomation.com/en-id/sitemapindex.xml
59Sitemap: https://www.rockwellautomation.com/en-sg/sitemapindex.xml
60Sitemap: https://www.rockwellautomation.com/en-in/sitemapindex.xml
61Sitemap: https://www.rockwellautomation.com/ja-jp/sitemapindex.xml
62Sitemap: https://www.rockwellautomation.com/ko-kr/sitemapindex.xml
63Sitemap: https://www.rockwellautomation.com/zh-cn/sitemapindex.xml
64Sitemap: https://www.rockwellautomation.com/zh-tw/sitemapindex.xml
65
66# Disallow PDP - North America
67Disallow: /en-ca/products/details
68Disallow: /fr-ca/products/details
69
70# Disallow PDP - Europe, the Middle East, Africa
71Disallow: /en-dk/products/details
72Disallow: /en-fi/products/details
73Disallow: /en-hu/products/details
74Disallow: /en-ie/products/details
75Disallow: /en-il/products/details
76Disallow: /en-no/products/details
77Disallow: /en-ro/products/details
78Disallow: /en-gb/products/details
79Disallow: /en-ua/products/details
80Disallow: /en-za/products/details
81Disallow: /en-pl/products/details
82Disallow: /en-tr/products/details
83Disallow: /en-ru/products/details
84Disallow: /en-se/products/details
85Disallow: /en-cz/products/details
86Disallow: /en-be/products/details
87Disallow: /en-nl/products/details
88Disallow: /en-mde/products/details
89Disallow: /de-de/products/details
90Disallow: /de-at/products/details
91Disallow: /de-ch/products/details
92Disallow: /es-es/products/details
93Disallow: /fr-fr/products/details
94Disallow: /fr-be/products/details
95Disallow: /fr-ch/products/details
96Disallow: /it-it/products/details
97Disallow: /pt-pt/products/details
98
99# Disallow PDP - Latin America
100Disallow: /en-pr/products/details
101Disallow: /es-pr/products/details
102Disallow: /es-mx/products/details
103Disallow: /es-ar/products/details
104Disallow: /es-co/products/details
105Disallow: /pt-br/products/details
106
107# Disallow PDP - Asia-Pacific
108Disallow: /en-au/products/details
109Disallow: /en-nz/products/details
110Disallow: /en-id/products/details
111Disallow: /en-sg/products/details
112Disallow: /en-in/products/details
113Disallow: /ja-jp/products/details
114Disallow: /ko-kr/products/details
115Disallow: /zh-cn/products/details
116Disallow: /zh-tw/products/details
117
118# Disallow Guides - North America
119Disallow: /en-us/docs
120Disallow: /en-ca/docs
121Disallow: /fr-ca/docs
122
123# Disallow Guides - Europe, the Middle East, Africa
124Disallow: /en-dk/docs
125Disallow: /en-fi/docs
126Disallow: /en-hu/docs
127Disallow: /en-ie/docs
128Disallow: /en-il/docs
129Disallow: /en-no/docs
130Disallow: /en-ro/docs
131Disallow: /en-gb/docs
132Disallow: /en-ua/docs
133Disallow: /en-za/docs
134Disallow: /en-pl/docs
135Disallow: /en-tr/docs
136Disallow: /en-ru/docs
137Disallow: /en-se/docs
138Disallow: /en-cz/docs
139Disallow: /en-be/docs
140Disallow: /en-nl/docs
141Disallow: /en-mde/docs
142Disallow: /de-de/docs
143Disallow: /de-at/docs
144Disallow: /de-ch/docs
145Disallow: /es-es/docs
146Disallow: /fr-fr/docs
147Disallow: /fr-be/docs
148Disallow: /fr-ch/docs
149Disallow: /it-it/docs
150Disallow: /pt-pt/docs
151
152# Disallow Guides - Latin America
153Disallow: /en-pr/docs
154Disallow: /es-pr/docs
155Disallow: /es-mx/docs
156Disallow: /es-ar/docs
157Disallow: /es-co/docs
158Disallow: /pt-br/docs
159
160# Disallow Guides - Asia-Pacific
161Disallow: /en-au/docs
162Disallow: /en-nz/docs
163Disallow: /en-id/docs
164Disallow: /en-sg/docs
165Disallow: /en-in/docs
166Disallow: /ja-jp/docs
167Disallow: /ko-kr/docs
168Disallow: /zh-cn/docs
169Disallow: /zh-tw/docs