NeuralCrawl

Dell Technologies / robots.txt

← back to dell.com · change detected 1mo ago (2026-09-20T16:01:38Z) · modified +1 −12

What changed

Diff old (2026-09-20T09:54:02Z) → new (2026-09-20T16:01:38Z)

@@ -1,20 +1,9 @@
11  User-agent: *
22  #NewCo launch entries
33  Disallow: */shopping/
4- Disallow: */learn/lp/
5- Disallow: */campaign/lp/
6- Disallow: */legal/lp/
74  Disallow: */shop/*/ar/*/appref=*
8- Disallow: */shop/*/*/apd/*/*/-
9-
10- #OldCo launch entries
11- Disallow: */spd/*
12- Disallow: */lp/
135  Disallow: */shop/*/ar/*
14- Disallow: */ar/*/*?appliedRefinements=*
156  Disallow: */shop/*/apd/*
16- Disallow: */shop/*/scr/*
17-
187 
198  #Temporary launch entries
209  Disallow: /csbapi/unified-communication/*
@@ -1278,4 +1267,4 @@
12781267  Sitemap: https://www.dell.com/index-downloads-dell-pdfs-sitemap.xml.gz
12791268  Sitemap: https://www.dell.com/index-dt-sitemap.xml.gz
12801269 
1281- # Last Modified on 2026 Sep 19th, 10:00pm CST
1270+ # Last Modified on 2026 Sep 20th, 9.35am CST