Walmart / robots.txt snapshot
← back to walmart.com · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 3580 bytes · sha256 ff8182a46d9d37d2 · raw
final URL: https://www.walmart.com/robots.txt
| 1 | #Sitemaps-https |
| 2 | |
| 3 | Sitemap: https://www.walmart.com/sitemap_category.xml |
| 4 | Sitemap: https://www.walmart.com/sitemap_store_main.xml |
| 5 | |
| 6 | Sitemap: https://www.walmart.com/help/sitemap_gm.xml |
| 7 | Sitemap: https://www.walmart.com/sitemap_browse_fst.xml |
| 8 | Sitemap: https://www.walmart.com/sitemap_store_dept.xml |
| 9 | |
| 10 | Sitemap: https://www.walmart.com/sitemap_tp_legacy.xml |
| 11 | Sitemap: https://www.walmart.com/sitemap_tp_at.xml |
| 12 | Sitemap: https://www.walmart.com/sitemap_tp_br.xml |
| 13 | Sitemap: https://www.walmart.com/sitemap_tp_kp.xml |
| 14 | |
| 15 | Sitemap: https://www.walmart.com/sitemap_brp_02.xml |
| 16 | Sitemap: https://www.walmart.com/sitemap_brp_03.xml |
| 17 | Sitemap: https://www.walmart.com/sitemap_brp_04.xml |
| 18 | Sitemap: https://www.walmart.com/sitemap_brp_05.xml |
| 19 | Sitemap: https://www.walmart.com/sitemap_brp_06.xml |
| 20 | Sitemap: https://www.walmart.com/sitemap_brp_07.xml |
| 21 | Sitemap: https://www.walmart.com/sitemap_brp_08.xml |
| 22 | Sitemap: https://www.walmart.com/sitemap_brp_09.xml |
| 23 | |
| 24 | Sitemap: https://www.walmart.com/sitemap_itp_01.xml |
| 25 | Sitemap: https://www.walmart.com/sitemap_itp_02.xml |
| 26 | Sitemap: https://www.walmart.com/sitemap_itp_03.xml |
| 27 | |
| 28 | Sitemap: https://www.walmart.com/sitemap_rp_01.xml |
| 29 | Sitemap: https://www.walmart.com/sitemap_rp_02.xml |
| 30 | Sitemap: https://www.walmart.com/sitemap_rp_03.xml |
| 31 | Sitemap: https://www.walmart.com/sitemap_rp_04.xml |
| 32 | Sitemap: https://www.walmart.com/sitemap_rp_05.xml |
| 33 | |
| 34 | Sitemap: https://www.walmart.com/sitemap_slp_01.xml |
| 35 | Sitemap: https://www.walmart.com/sitemap_slp_02.xml |
| 36 | |
| 37 | Sitemap: https://www.walmart.com/sitemap_auto_dir.xml |
| 38 | |
| 39 | Sitemap: https://www.walmart.com/sitemap_brndshp_brand.xml |
| 40 | |
| 41 | Sitemap: https://www.walmart.com/sitemap_sp.xml |
| 42 | |
| 43 | Sitemap: https://www.walmart.com/sitemap_hi_ip.xml |
| 44 | Sitemap: https://www.walmart.com/sitemap_hi_tp.xml |
| 45 | Sitemap: https://www.walmart.com/sitemap_hi_bp.xml |
| 46 | Sitemap: https://www.walmart.com/sitemap_hi_mp.xml |
| 47 | |
| 48 | |
| 49 | #Disallow select URLs |
| 50 | User-agent: * |
| 51 | Disallow: /0/ |
| 52 | Disallow: /55875582/walmart-us/catalog/ |
| 53 | Disallow: /account/ |
| 54 | Disallow: /api/ |
| 55 | Disallow: /collection/api/logger |
| 56 | Disallow: /cp/-201 |
| 57 | Disallow: /cp/-302 |
| 58 | Disallow: /cp/-306 |
| 59 | Disallow: /cp/-309 |
| 60 | Disallow: /cp/-506 |
| 61 | Disallow: /cp/-509 |
| 62 | Disallow: /cp/api/logger |
| 63 | Disallow: /cp/api/wpa |
| 64 | Disallow: /cservice/ |
| 65 | Disallow: /cservice/ya_index.gsp |
| 66 | Disallow: /electrode/api/logger |
| 67 | Disallow: /email_collect/ |
| 68 | Disallow: /giftregistry/ |
| 69 | Disallow: /msp |
| 70 | Disallow: /nonConfig/api/wpa |
| 71 | Disallow: /popup_security.jsp |
| 72 | Disallow: /product/electrode/api/logger |
| 73 | Disallow: /product/electrode/api/wpa |
| 74 | Allow: /reviews/product/ |
| 75 | Allow: /reviews/seller/ |
| 76 | Disallow: /search |
| 77 | Disallow: /search/api/wpa |
| 78 | Disallow: */api/wpa |
| 79 | Disallow: */midas/* |
| 80 | Disallow: /search/search-ng.do |
| 81 | Disallow: /solutions/ |
| 82 | Disallow: /store/ajax/detail-navigation |
| 83 | Disallow: /store/ajax/local-store |
| 84 | Disallow: /store/ajax/preferred |
| 85 | Disallow: /store/ajax/search |
| 86 | Disallow: /store/ajax/visited-store |
| 87 | Disallow: /store/category/ |
| 88 | Disallow: /store/electrode/api/fetch-coupons |
| 89 | Disallow: /store/electrode/api/logger |
| 90 | Disallow: /store/electrode/api/p13n |
| 91 | Disallow: /store/electrode/api/search |
| 92 | Disallow: /store/electrode/api/stores |
| 93 | Allow: /store/finder |
| 94 | Disallow: /store/popular_in_grade/ |
| 95 | Disallow: /storeLocator/ |
| 96 | Disallow: /storeLocator/ca_storefinder_results.do |
| 97 | Disallow: /tealeaf |
| 98 | Disallow: /topic/electrode/api/logger |
| 99 | Disallow: /topic/electrode/api/wpa |
| 100 | Disallow: /typeahead/ |
| 101 | Disallow: /wmflows/ |
| 102 | Disallow: */undefined/* |
| 103 | Disallow: /store/*/search |
| 104 | Disallow: /c/kp/*/page/* |
| 105 | Disallow: /feeds/* |
| 106 | Disallow: /orders |
| 107 | Disallow: /es/ |
| 108 | Disallow: /swag/* |
| 109 | Disallow: /dad/trk |
| 110 | Disallow: /sp/* |
| 111 | |
| 112 | #Crawler specific settings |
| 113 | User-agent: Adsbot-Google |
| 114 | |
| 115 | User-agent: Mediapartners-Google |
| 116 | |
| 117 | # slow down Yahoo |
| 118 | User-agent: Slurp |
| 119 | Crawl-delay: 5 |