Advance Auto Parts / robots.txt
← back to advanceautoparts.com · change detected 20d ago (2026-10-18T07:39:59Z) · modified +0 −49
What changed
- Removed all rules for user-agent ‘*’
- 🤖 AIUnblocked Applebot-Extended (Apple) - rules removed
- 🤖 AIUnblocked Bytespider (ByteDance) - rules removed
- 🤖 AIUnblocked CCBot (Common Crawl) - rules removed
- 🤖 AIUnblocked ClaudeBot (Anthropic) - rules removed
- 🤖 AIUnblocked Google-Extended (Google) - rules removed
- 🤖 AIUnblocked GPTBot (OpenAI) - rules removed
- Removed all rules for user-agent ‘Mediapartners-Google’
- 🤖 AIUnblocked meta-externalagent (Meta) - rules removed
- Removed sitemap https://shop.advanceautoparts.com/sitemap.xml
Diff old (2026-10-17T13:20:03Z) → new (2026-10-18T07:39:59Z)
| @@ -1,49 +1,0 @@ | ||
| 1 | - User-agent: Mediapartners-Google | |
| 2 | - Disallow: | |
| 3 | - | |
| 4 | - User-agent: GPTBot | |
| 5 | - Disallow: / | |
| 6 | - | |
| 7 | - User-agent: ClaudeBot | |
| 8 | - Disallow: / | |
| 9 | - | |
| 10 | - User-agent: Google-Extended | |
| 11 | - Disallow: / | |
| 12 | - | |
| 13 | - User-agent: Applebot-Extended | |
| 14 | - Disallow: / | |
| 15 | - | |
| 16 | - User-agent: CCBot | |
| 17 | - Disallow: / | |
| 18 | - | |
| 19 | - User-agent: Meta-ExternalAgent | |
| 20 | - Disallow: / | |
| 21 | - | |
| 22 | - User-agent: Bytespider | |
| 23 | - Disallow: / | |
| 24 | - | |
| 25 | - User-agent: * | |
| 26 | - Disallow: /capi/ | |
| 27 | - Disallow: */LogonForm* | |
| 28 | - Disallow: */ForgotPasswordView* | |
| 29 | - Disallow: */UserRegistrationForm* | |
| 30 | - Disallow: */Address* | |
| 31 | - Disallow: */TemporaryPasswordSentForm | |
| 32 | - Disallow: */*Order* | |
| 33 | - Disallow: */WriteAReviewView* | |
| 34 | - Disallow: */StoreLocatorDetailView* | |
| 35 | - Disallow: */StoreLocatorView* | |
| 36 | - | |
| 37 | - #Disallow SearchResults urls | |
| 38 | - Disallow: */*?sortBy=MOST_POPULAR | |
| 39 | - Disallow: */*?sortBy=TOP_RATED | |
| 40 | - Disallow: */*?sortBy=PRICE_LOW_HIGH | |
| 41 | - Disallow: */*?sortBy=PRICE_HIGH_LOW | |
| 42 | - Disallow: */*?sortBy=NAME_A_Z | |
| 43 | - Disallow: */*?sortBy=NAME_Z_A | |
| 44 | - Disallow: */web/* | |
| 45 | - Disallow: */*storeCode=* | |
| 46 | - Disallow: */*searchTerm=* | |
| 47 | - Disallow: */*storeId=* | |
| 48 | - | |
| 49 | - Sitemap: https://shop.advanceautoparts.com/sitemap.xml |