NeuralCrawl

Dollar Tree / robots.txt snapshot

← back to dollartree.com · fetched 2026-06-20T01:10:31Z (18h ago) · HTTP 200 · 876 bytes · sha256 48239d8c17e61e2f · raw

final URL: https://www.dollartree.com/robots.txt

1User-agent: *
2Disallow: /cart
3Disallow: /checkout
4Disallow: /profile
5Disallow: /confirmation
6Disallow: /wishlist_settings
7Disallow: /wishlist
8Disallow: /en/cart
9Disallow: /en/checkout
10Disallow: /en/profile
11Disallow: /en/searchresults
12Disallow: /en/confirmation
13Disallow: /en/wishlist_settings
14Disallow: /en/wishlist
15Disallow: /es/cart
16Disallow: /es/checkout
17Disallow: /es/profile
18Disallow: /es/searchresults
19Disallow: /es/confirmation
20Disallow: /es/wishlist_settings
21Disallow: /es/wishlist
22Disallow: /es/lpc/*?
23Disallow: /lpc/*?
24Disallow: /ppc/*?
25Disallow: /product/*?
26Disallow: /bulk/
27
28Sitemap: https://www.globalsiteseo.com/dollar_tree.GSM/dollar_tree.gsm.index.en_super.xml
29Sitemap: https://www.globalsiteseo.com/dollar_tree.GSM/dollar_tree.gsm.index.es_super.xml
30Sitemap: https://www.dollartree.com/bulk/sitemapindex.xml.gz
31Sitemap: https://www.dollartree.com/sitemap.xml