Ralph Lauren / robots.txt
← back to ralphlauren.com · change detected 2mo ago (2026-08-10T14:47:29Z) · modified +21 −19
What changed
- Added Disallow: */Checkout-GetBillCountries for *
- Added Disallow: */CheckoutServices-ExistingCustomer for *
- Added Disallow: */Header-MenuFlyouts for *
- Added Disallow: */Product-AlsoAvailable for *
- Added Disallow: */Product-HitTile for *
- Added Disallow: */Product-Look for *
- Added Disallow: */Product-PDPOMSEDDLookup for *
- Added Disallow: */Product-Show for *
- Added Disallow: */Product-ShowInCategory for *
- Added Disallow: */ProductRecs-GetContext for *
- Added Disallow: */Wishlist-Add for *
- Added Disallow: */Wishlist-Include for *
- Added Disallow: */Wishlist-IncludeJSON for *
- Added Disallow: */Wishlist-Remove for *
- Added Disallow: *__SYSTEM__ApplePay-GetRequest for *
- Removed Disallow: */Checkout-GetBillCountries for yahoo-blogs/v3.9
- Removed Disallow: */CheckoutServices-ExistingCustomer for yahoo-blogs/v3.9
- Removed Disallow: */Header-MenuFlyouts for yahoo-blogs/v3.9
- Removed Disallow: */Product-AlsoAvailable for yahoo-blogs/v3.9
- Removed Disallow: */Product-HitTile for yahoo-blogs/v3.9
- Removed Disallow: */Product-Look for yahoo-blogs/v3.9
- Removed Disallow: */Product-PDPOMSEDDLookup for yahoo-blogs/v3.9
- Removed Disallow: */Product-Show for yahoo-blogs/v3.9
- Removed Disallow: */Product-ShowInCategory for yahoo-blogs/v3.9
- Removed Disallow: */Product-Variation for yahoo-blogs/v3.9
- Removed Disallow: */ProductRecs-GetContext for yahoo-blogs/v3.9
- Removed Disallow: */Search-Show for yahoo-blogs/v3.9
- Removed Disallow: */Wishlist-Add for yahoo-blogs/v3.9
- Removed Disallow: */Wishlist-Include for yahoo-blogs/v3.9
- Removed Disallow: */Wishlist-IncludeJSON for yahoo-blogs/v3.9
- Removed Disallow: */Wishlist-Remove for yahoo-blogs/v3.9
- Removed Disallow: *__SYSTEM__ApplePay-GetRequest for yahoo-blogs/v3.9
Diff old (2026-07-22T13:48:59Z) → new (2026-08-10T14:47:29Z)
| @@ -1,3 +1,4 @@ | ||
| 1 | + #--DO_NOT_REMOVE-Sitemap_cross_check-start_of_web_rules-- | |
| 1 | 2 | User-agent: * |
| 2 | 3 | #Don't crawl certain end points |
| 3 | 4 | Disallow: */CQRecomm-Start |
| @@ -46,7 +47,26 @@ | ||
| 46 | 47 | Disallow: */r/*_* |
| 47 | 48 | Disallow: /*sale*/r/* |
| 48 | 49 | Disallow: /*gift*/r/* |
| 49 | - | |
| 50 | + | |
| 51 | + Disallow: */Header-MenuFlyouts | |
| 52 | + Disallow: */ProductRecs-GetContext | |
| 53 | + Disallow: */Product-AlsoAvailable | |
| 54 | + Disallow: */Product-PDPOMSEDDLookup | |
| 55 | + Disallow: */Product-Look | |
| 56 | + Disallow: */Wishlist-IncludeJSON | |
| 57 | + Disallow: */Product-Show | |
| 58 | + Disallow: */Product-Variation | |
| 59 | + Disallow: */Product-ShowInCategory | |
| 60 | + Disallow: */Wishlist-Add | |
| 61 | + Disallow: */Wishlist-Include | |
| 62 | + Disallow: */Wishlist-Remove | |
| 63 | + Disallow: */Product-HitTile | |
| 64 | + Disallow: */Checkout-GetBillCountries | |
| 65 | + Disallow: */CheckoutServices-ExistingCustomer | |
| 66 | + Disallow: *__SYSTEM__ApplePay-GetRequest | |
| 67 | + | |
| 68 | + #--DO_NOT_REMOVE-Sitemap_cross_check-end_of_web_rules-- | |
| 69 | + | |
| 50 | 70 | User-agent: Robozilla |
| 51 | 71 | Disallow: / |
| 52 | 72 | User-agent: yahoo-mmcrawler |
| @@ -58,22 +78,4 @@ | ||
| 58 | 78 | User-agent: yahoo-blogs/v3.9 |
| 59 | 79 | Disallow: / |
| 60 | 80 | |
| 61 | - Disallow: */Header-MenuFlyouts | |
| 62 | - Disallow: */ProductRecs-GetContext | |
| 63 | - Disallow: */Product-AlsoAvailable | |
| 64 | - Disallow: */Product-PDPOMSEDDLookup | |
| 65 | - Disallow: */Product-Look | |
| 66 | - Disallow: */Wishlist-IncludeJSON | |
| 67 | - Disallow: */Product-Show | |
| 68 | - Disallow: */Product-Variation | |
| 69 | - Disallow: */Product-ShowInCategory | |
| 70 | - Disallow: */Search-Show | |
| 71 | - Disallow: */Wishlist-Add | |
| 72 | - Disallow: */Wishlist-Include | |
| 73 | - Disallow: */Wishlist-Remove | |
| 74 | - Disallow: */Product-Variation | |
| 75 | - Disallow: */Product-HitTile | |
| 76 | - Disallow: */Checkout-GetBillCountries | |
| 77 | - Disallow: */CheckoutServices-ExistingCustomer | |
| 78 | - Disallow: *__SYSTEM__ApplePay-GetRequest | |
| 79 | 81 | Sitemap: https://www.ralphlauren.com/index |