Arrow Electronics / robots.txt
← back to arrow.com · change detected 1mo ago (2026-09-30T01:00:52Z) · created +6 −5
What changed
- Removed Disallow: *%3Fregion* for *
- Removed Disallow: */arrow-dxp/language-masters/ for *
- Removed Disallow: *?region* for *
- Removed Disallow: *utm_source=* for *
- Removed Disallow: /content/arrow-dxp/ for *
Diff old (2026-08-11T02:59:22Z) → new (2026-09-30T01:00:52Z)
| @@ -9,14 +9,15 @@ | ||
| 9 | 9 | Disallow: */design-center/my-projects |
| 10 | 10 | Disallow: /technical-content/ |
| 11 | 11 | |
| 12 | - Disallow: *?region* | |
| 13 | - Disallow: *utm_source=* | |
| 14 | - Disallow: *%3Fregion* | |
| 12 | + #Commenting all below lines to allow crawling of URLs with query paramters | |
| 13 | + #Disallow: *?region* | |
| 14 | + #Disallow: *utm_source=* | |
| 15 | + #Disallow: *%3Fregion* | |
| 15 | 16 | |
| 16 | 17 | Disallow: */datasheets/ |
| 17 | 18 | Disallow: */login* |
| 18 | - Disallow: */arrow-dxp/language-masters/ | |
| 19 | - Disallow: /content/arrow-dxp/ | |
| 19 | + #Disallow: */arrow-dxp/language-masters/ | |
| 20 | + #Disallow: /content/arrow-dxp/ | |
| 20 | 21 | |
| 21 | 22 | Disallow: /~/media/technical-content/ |
| 22 | 23 | Disallow: */my-account |