NeuralCrawl

Tractor Supply / robots.txt

← back to tractorsupply.com · change detected 1mo ago (2026-06-23T09:46:45Z) · modified +125 −123

What changed

Diff old (2026-06-20T01:10:31Z) → new (2026-06-23T09:46:45Z)

@@ -2,133 +2,86 @@
22 
33  Crawl-delay: 1
44 
5- Disallow: /AjaxCheckoutDisplayView*
6- Disallow: /CheckoutGuestView*
7- Disallow: /OrderShippingBillingView*
8- Disallow: /OrderShippingBillingConfirmationView*
9- Disallow: /OrderLookUpView*
10- Disallow: /OrderLookUpResultsView*
11- Disallow: /UserRegistrationAddFormView*
12- Disallow: /TrackOrderStatus*
13- Disallow: /OrderDetail*
14- Disallow: /AddressBookForm*
15- Disallow: /ResetPasswordForm*
16- Disallow: /ResetPasswordErrorView*
17- Disallow: /ChangePassword*
18- Disallow: /WishListDisplayView*
19- Disallow: /AjaxAccountWishListDisplayView*
20- Disallow: /WishListResultDisplayView*
21- Disallow: /OpenIdLogin*
22- Disallow: /OrderLookUpForm*
23- Disallow: /ValidatePasswordAndSignUpForm*
24- Disallow: /AjaxUserRegistrationAddressForm*
25- Disallow: /AjaxAddressVerificationService*
26- Disallow: /TopCategoriesDisplay*
5+ Disallow: */ajaxlogonform*
6+ Disallow: */article*
7+ Disallow: */bayAisleWcs/*
8+ Disallow: */pdplite/*
9+ Disallow: */wayfinding/getAccessToken*
10+ Disallow: */wcs/resources/store/*
11+ Disallow: */wcsstore/*
12+ Disallow: */webapp/*
13+ Disallow: */AjaxContentRecommendationView*
14+ Disallow: */AjaxExpFragmentView*
15+ Disallow: */AjaxFooterDisplayView*
16+ Disallow: */AjaxStoreLocatorDisplayView*
17+ Disallow: */AjaxStoreLocatorFilterView*
18+ Disallow: */AjaxTSCFetchInStoreDetails*
19+ Disallow: */AjaxTSCGetPetVetContent*
20+ Disallow: */AjaxTSCGetTrueFitContent*
21+ Disallow: */AjaxTSCGetWarrantyOptionsView*
22+ Disallow: */AjaxTSCOnlineServicesView*
23+ Disallow: */AjaxTSCRESTFetchStoreFinancePlans
24+ Disallow: */AjaxTSCRESTmakeMyStore*
25+ Disallow: */AttachmentPaginationListView*
2726  Disallow: */CategoryDisplay*
27+ Disallow: */ClickInfo*
2828  Disallow: */ProductDisplay*
2929  Disallow: */SearchDisplay*
30+ Disallow: */SearchComponentCachedSuggestionsView*
31+ Disallow: */TSCFetchItemDetails*
32+ Disallow: */TSCPromotionsFromSolrView*
3033  Disallow: */UserRegistrationForm*
34+ Disallow: /*getRecItemDetails
35+ Disallow: /*loginidentity*
36+ Disallow: /*Logon*
37+ Disallow: /*socialLogin*
38+ Disallow: /AddressBookForm*
39+ Disallow: /AccountDashboardView*
40+ Disallow: /AjaxAccountWishListDisplayView*
41+ Disallow: /AjaxAddressVerificationService*
42+ Disallow: /AjaxCheckoutDisplayView*
43+ Disallow: /AjaxContactUsService*
44+ Disallow: /AjaxCreateReturnOrder*
45+ Disallow: /AjaxEstimateChargeView*
46+ Disallow: /AjaxGiftListServiceAddItem*
47+ Disallow: /AjaxGiftListServiceCreate*
48+ Disallow: /AjaxKnowHowDisplayView*
49+ Disallow: /AjaxNewAddressVerificationService*
50+ Disallow: /AjaxOrderChangeServiceItemAdd*
51+ Disallow: /AjaxOrderChangeServiceItemDelete*
52+ Disallow: /AjaxOrderChangeServiceItemUpdate*
3153  Disallow: /AjaxOrderItemDisplayView*
32- Disallow: /QuickInfoDetailsView*
33- Disallow: /TSCOrderItemDetailsDisplay*
34- Disallow: /current-ads*
35- Disallow: */SearchComponentCachedSuggestionsView*
36- Disallow: /SearchComponentAutoSuggestView*
37- Disallow: /IntelligentOfferResultsView*
38- Disallow: /AjaxEstimateChargeView*
39- Disallow: /AjaxUpdateLTLInfo*
40- Disallow: /MiniShopCartDisplayView*
41- Disallow: /AjaxOrderChangeServiceItemAdd*
42- Disallow: /AjaxOrderChangeServiceItemUpdate*
43- Disallow: /TSCCheckoutDisplayShippingCmd*
44- Disallow: /AjaxPersonChangeServiceAddressAdd*
45- Disallow: /AjaxNewAddressVerificationService*
46- Disallow: /AjaxSaveAddressUpdateShipInfo*
47- Disallow: /TSCCheckoutDisplayPickupDetailsCmd*
48- Disallow: /AjaxSavePickupPersonDetails*
49- Disallow: /TSCCheckoutDisplayShippingMethodCmd*
50- Disallow: /AjaxUpdateShippingSpeedForAnItem*
51- Disallow: /TSCCheckoutDisplayBillingAndPaymentDetailsCmd*
52- Disallow: /AjaxTSCPIAdd*
53- Disallow: /TSCCheckoutDisplayReviewPageDetailsCmd*
5454  Disallow: /AjaxOrderProcessServiceOrderPrepare*
5555  Disallow: /AjaxOrderProcessServiceOrderSubmit*
56- Disallow: /AjaxUpdateShippingAddress*
56+ Disallow: /AjaxPersonChangeServiceAddressAdd*
5757  Disallow: /AjaxPromotionCodeManage*
58+ Disallow: /AjaxSaveAddressUpdateShipInfo*
59+ Disallow: /AjaxSaveAlternativePickupPerson*
60+ Disallow: /AjaxSavePickupPersonDetails*
61+ Disallow: /AjaxSSFSOrderCopy*
5862  Disallow: /AjaxStoreLocatorOverlayView*
5963  Disallow: /AjaxSubCategoryDesktopDisplayView*
60- Disallow: /AjaxGiftListServiceAddItem*
61- Disallow: /AjaxSaveAlternativePickupPerson*
62- Disallow: /AjaxKnowHowDisplayView*
63- Disallow: /AjaxContactUsService*
64- Disallow: /AjaxGiftListServiceCreate*
65- Disallow: /AjaxSSFSOrderCopy*
66- Disallow: /AjaxOrderChangeServiceItemDelete*
67- Disallow: */ClickInfo*
68- Disallow: /Logoff*
69- Disallow: /en/store*
70- Disallow: /en/store/search*
71- Disallow: /detail.asp*
72- Disallow: /*Logon*
73- Disallow: /tsc/cs*
74- Disallow: /tsc/vc*
75- Disallow: /AccountDashboardView*
76- Disallow: /CompareProductsDisplayView*
77- Disallow: /QuickInfoDetailsView*?*
78- Disallow: /LogoffView*
79- Disallow: /ProductListingView*
80- Disallow: /ReturnProcessView*
81- Disallow: /AjaxCreateReturnOrder*
82- Disallow: /TSCAjaxReturnCmd*
83- Disallow: /ResetPasswordGuestErrorView*
84- Disallow: /tsc/search*
85- Disallow: /TSCCheckGiftCardView*
86- Disallow: /tsc/current-ads*
87- Disallow: /TSCShoppingCartView*
88- Disallow: /TSCDeliveryPickupDetailsView*
89- Disallow: /TSCPaymentPageView*
90- Disallow: /TSCOrderConfirmationView*
91- Disallow: */TSCPromotionsFromSolrView*
92- Disallow: */wcsstore/*
93- Disallow: */wcs/resources/store/*
94- Disallow: */AjaxTSCRESTmakeMyStore*
95- Disallow: */AjaxTSCGetTrueFitContent*
96- Disallow: */AjaxTSCGetWarrantyOptionsView*
97- Disallow: */AjaxTSCGetPetVetContent*
98- Disallow: */AjaxTSCOnlineServicesView*
99- Disallow: */AjaxContentRecommendationView*
100- Disallow: */bayAisleWcs/*
101- Disallow: */AjaxFooterDisplayView*
102- Disallow: */AjaxExpFragmentView*
103- Disallow: */AttachmentPaginationListView*
104- Disallow: */AjaxTSCFetchInStoreDetails*
105- Disallow: */AjaxStoreLocatorFilterView*
106- Disallow: */ajaxlogonform*
107- Disallow: */AjaxStoreLocatorDisplayView*
108- Disallow: */TSCFetchItemDetails*
109- Disallow: */wayfinding/getAccessToken*
110-
64+ Disallow: /AjaxTSCPIAdd*
11165  Disallow: /AjaxTSCRestAddressValidation
11266  Disallow: /AjaxTSCRESTAddTaxExemption
11367  Disallow: /AjaxTSCRESTChangeGiftListStatus
114- Disallow: /AjaxTSCRESTContactCustSolution
68+ Disallow: /AjaxTSCRESTContactCustSolution
69+ Disallow: /AjaxTSCRestCreditInquiry*
11570  Disallow: /AjaxTSCRestEmployeeStatus
116- Disallow: */AjaxTSCRESTFetchStoreFinancePlans
11771  Disallow: /AjaxTSCRESTGetSubscriptionStatus
118- Disallow: /AjaxTSCRESTGetSubscriptionStatus
72+ Disallow: /AjaxTSCRESTGetSubscriptionStatus
11973  Disallow: /AjaxTSCRESTGiftListServiceAddItem
12074  Disallow: /AjaxTSCRESTGiftListServiceCreate
12175  Disallow: /AjaxTSCRESTGiftListServiceUpdateDescription
12276  Disallow: /AjaxTSCRESTLoyaltyServices
12377  Disallow: /AjaxTSCRESTManagePayment
124- Disallow: /AjaxTSCRESTOrderCalculate
78+ Disallow: /AjaxTSCRESTOrderCalculate
12579  Disallow: /AjaxTSCRestPersonChangeServiceAddressAdd
12680  Disallow: /AjaxTSCRestPersonChangeServiceAddressDelete
12781  Disallow: /AjaxTSCRestPersonChangeServiceAddressUpdate
128- Disallow: /AjaxTSCRestPersonChangeServiceAddressUpdate
129- Disallow: /AjaxTSCRestPersonChangeServicePersonUpdate
82+ Disallow: /AjaxTSCRestPersonChangeServicePersonUpdate
13083  Disallow: /AjaxTSCRestPersonProcessServicePersonRegister
131- Disallow: /AjaxTSCRESTResetPasswordMail
84+ Disallow: /AjaxTSCRESTResetPasswordMail
13285  Disallow: /AjaxTSCRESTReturnOnline
13386  Disallow: /AjaxTSCRESTReviewReturnItems
13487  Disallow: /AjaxTSCRESTServiceDeleteGiftList
@@ -136,30 +89,79 @@
13689  Disallow: /AjaxTSCRESTUpdatePassword
13790  Disallow: /AjaxTSCReturnInStoreCmd
13891  Disallow: /AjaxTSCReturnShippingLabel
92+ Disallow: /AjaxUpdateLTLInfo*
93+ Disallow: /AjaxUpdateShippingAddress*
94+ Disallow: /AjaxUpdateShippingSpeedForAnItem*
95+ Disallow: /AjaxUserRegistrationAddressForm*
96+ Disallow: /ChangePassword*
97+ Disallow: /CheckoutGuestView*
98+ Disallow: /CompareProductsDisplayView*
99+ Disallow: /current-ads*
100+ Disallow: /detail.asp*
101+ Disallow: /IntelligentOfferResultsView*
102+ Disallow: /Logoff*
103+ Disallow: /LogoffView*
104+ Disallow: /MiniShopCartDisplayView*
105+ Disallow: /OpenIdLogin*
106+ Disallow: /OrderDetail*
107+ Disallow: /OrderLookUpForm*
108+ Disallow: /OrderLookUpResultsView*
109+ Disallow: /OrderLookUpView*
110+ Disallow: /OrderShippingBillingView*
111+ Disallow: /OrderShippingBillingConfirmationView*
112+ Disallow: /ProductListingView*
113+ Disallow: /QuickInfoDetailsView*
114+ Disallow: /QuickInfoDetailsView*?*
115+ Disallow: /ResetPasswordErrorView*
116+ Disallow: /ResetPasswordForm*
117+ Disallow: /ResetPasswordGuestErrorView*
118+ Disallow: /ReturnProcessView*
119+ Disallow: /SearchComponentAutoSuggestView*
120+ Disallow: /TopCategoriesDisplay*
121+ Disallow: /TrackOrderStatus*
122+ Disallow: /TSCAjaxReturnCmd*
123+ Disallow: /TSCApplyAndBuyReview*
124+ Disallow: /TSCATCInterstitialModal*
125+ Disallow: /TSCBillingPaymentSinglePageRefreshView*
126+ Disallow: /TSCCheckGiftCardView*
127+ Disallow: /TSCCheckoutBillingAddressDetailsSinglePageView*
128+ Disallow: /TSCCheckoutBillingAddressSinglePageView*
129+ Disallow: /TSCCheckoutDeliveryPickupListSinglePageView*
130+ Disallow: /TSCCheckoutDisplayBillingAndPaymentDetailsCmd*
131+ Disallow: /TSCCheckoutDisplayPickupDetailsCmd*
132+ Disallow: /TSCCheckoutDisplayReviewPageDetailsCmd*
133+ Disallow: /TSCCheckoutDisplayShippingCmd*
134+ Disallow: /TSCCheckoutDisplayShippingMethodCmd*
135+ Disallow: /TSCDeliveryPickupDetailsView*
139136  Disallow: /TSCEmailVerification
137+ Disallow: /TSCFulfillmentStatusModal*
138+ Disallow: /TSCOrderConfirmationView*
139+ Disallow: /TSCOrderItemDetailsDisplay*
140+ Disallow: /TSCPaymentPageView*
140141  Disallow: /TSCReviewReturns*
142+ Disallow: /TSCShoppingCartView*
143+ Disallow: /TSCSinglePageCheckoutView*
144+ Disallow: /TSCSinglePageOrderSummaryView*
141145  Disallow: /TSCTaxExemptDashboardView
142- Disallow: /*loginidentity*
143- Disallow: /*socialLogin*
144- Disallow: /TSCATCInterstitialModal*
145- Disallow: /TSCFulfillmentStatusModal*
146- Disallow: /TSCSinglePageCheckoutView*
147- Disallow: /TSCCheckoutDeliveryPickupListSinglePageView*
148- Disallow: /TSCCheckoutBillingAddressSinglePageView*
149- Disallow: /TSCCheckoutBillingAddressDetailsSinglePageView*
150- Disallow: /TSCBillingPaymentSinglePageRefreshView*
151- Disallow: /TSCSinglePageOrderSummaryView*
152- Disallow: /TSCApplyAndBuyReview*
146+ Disallow: /TSCTwoWayCitiCallbackView*
153147  Disallow: /TSCWebTwoWayCitiCallbackView*
154- Disallow: /TSCTwoWayCitiCallbackView*
155- Disallow: /AjaxTSCRestCreditInquiry*
156-
157- Disallow: /*getRecItemDetails
158- Disallow: */webapp/*
159- Disallow: */article*
160- Disallow: */pdplite/*
148+ Disallow: /UserRegistrationAddFormView*
149+ Disallow: /ValidatePasswordAndSignUpForm*
150+ Disallow: /WishListDisplayView*
151+ Disallow: /WishListResultDisplayView*
152+ Disallow: /api/orch/*
153+ Disallow: /en/store*
154+ Disallow: /en/store/search*
155+ Disallow: /gtwy/api/ecom/purchase-history/order-details/*
156+ Disallow: /gtwy/api/ecom/purchase-history/order-list*
161157  Disallow: /gtwy/koddi/sponsored-products/event-collection/*
162- Disallow: /api/orch/*
158+ Disallow: /tsc/cart*
159+ Disallow: /tsc/checkout*
160+ Disallow: /tsc/cs*
161+ Disallow: /tsc/current-ads*
162+ Disallow: /tsc/orderconfirmation*
163+ Disallow: /tsc/orders*
164+ Disallow: /tsc/search*
165+ Disallow: /tsc/vc*
163166  Allow: /tsc/search/*?isItmUnpub=Y$
164167  Sitemap: https://www.tractorsupply.com/sitemap.xml
165-