Burlington Stores / robots.txt snapshot

← back to burlington.com · fetched 2026-06-20T01:10:31Z (18h ago) · HTTP 200 · 980 bytes · sha256 a4dbf6a289ab9bf1 · raw

final URL: https://www.burlington.com/robots.txt

1	User-Agent: *
2	Allow: /
3	Disallow: /search
4
5	# Disallow Rules
6
7	User-agent: anthropic-ai
8	Disallow: /
9
10	User-agent: Applebot
11	Disallow: /
12
13	User-agent: AwarioRssBot
14	Disallow: /
15
16	User-agent: AwarioSmartBot
17	Disallow: /
18
19	User-agent: Bytespider
20	Disallow: /
21
22	User-agent: CCBot
23	Disallow: /
24
25	User-agent: ChatGPT-User
26	Disallow: /
27
28	User-agent: ClaudeBot
29	Disallow: /
30
31	User-agent: Claude-Web
32	Disallow: /
33
34	User-agent: cohere-ai
35	Disallow: /
36
37	User-agent: DataForSeoBot
38	Disallow: /
39
40	User-agent: FriendlyCrawler
41	Disallow: /
42
43	User-agent: GPTBot
44	Disallow: /
45
46	User-agent: ImagesiftBot
47	Disallow: /
48
49	User-agent: magpie-crawler
50	Disallow: /
51
52	User-agent: Meltwater
53	Disallow: /
54
55	User-agent: omgili
56	Disallow: /
57
58	User-agent: omgilibot
59	Disallow: /
60
61	User-agent: peer39_crawler
62	Disallow: /
63
64	User-agent: peer39_crawler/1.0
65	Disallow: /
66
67	User-agent: PerplexityBot
68	Disallow: /
69
70	User-agent: PiplBot
71	Disallow: /
72
73	User-agent: Seekr
74	Disallow: /
75
76	User-agent: YouBot
77	Disallow: /
78
79	Sitemap: https://www.burlington.com/sitemap.xml