NeuralCrawl

Dell Technologies / robots.txt

← back to dell.com · change detected 1mo ago (2026-09-19T15:38:18Z) · modified +3 −17

What changed

Diff old (2026-09-19T09:33:52Z) → new (2026-09-19T15:38:18Z)

@@ -3,13 +3,6 @@
33  Disallow: */learn/lp/
44  Disallow: */campaign/lp/
55  Disallow: */legal/lp/
6- Disallow: */shop/alienware/gaming$
7- Disallow: */shop/alienware/gaming/*
8- Disallow: */shop/alienware/gaming?r=*
9- Disallow: */shop/deals/dc$
10- Disallow: */shop/deals/dc
11- Disallow: */shop/deals/*dc?appliedRefinements=*
12- Disallow: */shop/deals/*dc?appliedrefinements=*
136  Disallow: */shop/*/ar/*/appref=*
147  Disallow: */sac/*/*/*/appref=*
158  Disallow: */shop/dell-parts/partsbytype/*
@@ -19,22 +12,15 @@
1912  #OldCo launch entries
2013  Disallow: */spd/*
2114  Disallow: */lp/
22- Disallow: */gaming/alienware
23- Disallow: */shop/deals
24- Disallow: */shop/deals/*/*?appliedRefinements=*
25- Disallow: */shop/deals/*/*?appliedrefinements=*
2615  Disallow: */shop/*/ar/*
2716  Disallow: */ar/*/*?appliedRefinements=*
28- Disallow: */shop/*/sac/*
29- Disallow: */sac/*/*/*?appliedRefinements=*
30- Disallow: */shop/accessories$
31- Disallow: */shop/electronics$
3217  Disallow: */shop/partsforyourdell$
3318  Disallow: */shop/partsbytype/*
3419  Disallow: */shop/pfydresults/*
3520  Disallow: */shop/*/apd/*
3621  Disallow: */shop/*/scr/*
37- Disallow: */shop/compare?*
22+
23+
3824  #Temporary launch entries
3925  Disallow: /csbapi/unified-communication/*
4026  Disallow: *.less$
@@ -1298,4 +1284,4 @@
12981284  Sitemap: https://www.dell.com/index-downloads-dell-pdfs-sitemap.xml.gz
12991285  Sitemap: https://www.dell.com/index-dt-sitemap.xml.gz
13001286 
1301- # Last Modified on 2026 Sep 18th, 9:00pm CST
1287+ # Last Modified on 2026 Sep 19th, 7:00am CST