NeuralCrawl

O'Reilly Automotive / robots.txt snapshot

← back to oreillyauto.com · fetched 2026-06-20T01:10:31Z (18h ago) · HTTP 200 · 682 bytes · sha256 542afbf69643d5ab · raw

final URL: https://www.oreillyauto.com/robots.txt

1User-agent: rogerbot
2Disallow: /detail
3
4User-agent: *
5Disallow:/checkout
6Disallow:/signin
7Disallow:/search
8Disallow:/search/*
9Disallow:/create-account
10Disallow:/account
11Disallow:/account/*
12Disallow:/check-order-status
13Disallow:/signin?successUrl=*
14Disallow:/img/documents/*
15Disallow:/cmsstatic/*.pdf
16Allow:/cmsstatic/
17Disallow:/app/chat/chat_launch
18Disallow:/video/
19Disallow:/shipping-estimate/*
20Disallow:/checkfit/products
21Disallow:/checkfit/products/*
22Disallow:/*fitAttr
23Disallow:/*sort=*
24Disallow:/*page=*
25Disallow:/*pos=*
26Disallow:/*prodAttr
27Allow:/*prodAttr_32769=*
28Allow:/*prodAttr_34485=*
29Disallow:/*&Brands=
30Allow:/*Brands=*
31
32Sitemap:https://www.oreillyauto.com/sitemap.xml