NeuralCrawl

Advance Auto Parts / robots.txt

← back to advanceautoparts.com · change detected 14d ago (2026-10-23T15:24:48Z) · modified +49 −0

What changed

Diff old (2026-10-23T09:19:58Z) → new (2026-10-23T15:24:48Z)

@@ -1,0 +1,49 @@
1+ User-agent: Mediapartners-Google
2+ Disallow:
3+
4+ User-agent: GPTBot
5+ Disallow: /
6+
7+ User-agent: ClaudeBot
8+ Disallow: /
9+
10+ User-agent: Google-Extended
11+ Disallow: /
12+
13+ User-agent: Applebot-Extended
14+ Disallow: /
15+
16+ User-agent: CCBot
17+ Disallow: /
18+
19+ User-agent: Meta-ExternalAgent
20+ Disallow: /
21+
22+ User-agent: Bytespider
23+ Disallow: /
24+
25+ User-agent: *
26+ Disallow: /capi/
27+ Disallow: */LogonForm*
28+ Disallow: */ForgotPasswordView*
29+ Disallow: */UserRegistrationForm*
30+ Disallow: */Address*
31+ Disallow: */TemporaryPasswordSentForm
32+ Disallow: */*Order*
33+ Disallow: */WriteAReviewView*
34+ Disallow: */StoreLocatorDetailView*
35+ Disallow: */StoreLocatorView*
36+
37+ #Disallow SearchResults urls
38+ Disallow: */*?sortBy=MOST_POPULAR
39+ Disallow: */*?sortBy=TOP_RATED
40+ Disallow: */*?sortBy=PRICE_LOW_HIGH
41+ Disallow: */*?sortBy=PRICE_HIGH_LOW
42+ Disallow: */*?sortBy=NAME_A_Z
43+ Disallow: */*?sortBy=NAME_Z_A
44+ Disallow: */web/*
45+ Disallow: */*storeCode=*
46+ Disallow: */*searchTerm=*
47+ Disallow: */*storeId=*
48+
49+ Sitemap: https://shop.advanceautoparts.com/sitemap.xml