NeuralCrawl

Nike / robots.txt snapshot

← back to nike.com · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 3503 bytes · sha256 54ba534bff9e8b4c · raw

final URL: https://www.nike.com/robots.txt

1# www.nike.com robots.txt -- just crawl it.
2
3User-agent: *
4
5Disallow: */member/inbox
6Disallow: */member/settings
7Disallow: */p/
8Disallow: */checkout/
9Disallow: /*.swf$
10Disallow: /*.pdf$
11Disallow: /pdf/
12Disallow: /ar/help/
13Disallow: /br/help/
14Disallow: /hk/help/
15Disallow: /uy/help/
16Disallow: /xf/help/
17Disallow: /xl/help/
18Disallow: /xm/help/
19Disallow: /fragments/recommendations-carousel
20Disallow: /kr/en$
21Disallow: /kr/en/
22Disallow: */w/*-*z*z*z*z*z
23
24User-agent: Baiduspider
25Allow: /cn$
26Allow: /cn/
27Allow: /CN$
28Allow: /CN/
29Allow: /assets/
30Allow: /static/
31Allow: /styleguide/
32Disallow: */w?q=
33Disallow: */w/?q=
34Disallow: /
35
36User-agent: HaoSouSpider
37Allow: /cn$
38Allow: /cn/
39Allow: /CN$
40Allow: /CN/
41Allow: /assets/
42Allow: /static/
43Allow: /styleguide/
44Disallow: */w?q=
45Disallow: */w/?q=
46Disallow: /
47
48User-agent: Sogou web spider
49Allow: /cn$
50Allow: /cn/
51Allow: /CN$
52Allow: /CN/
53Allow: /assets/
54Allow: /static/
55Allow: /styleguide/
56Disallow: */w?q=
57Disallow: */w/?q=
58Disallow: /
59
60User-agent: Sogou inst spider
61Allow: /cn$
62Allow: /cn/
63Allow: /CN$
64Allow: /CN/
65Allow: /assets/
66Allow: /static/
67Allow: /styleguide/
68Disallow: */w?q=
69Disallow: */w/?q=
70Disallow: /
71
72User-agent: Sogou spider2
73Allow: /cn$
74Allow: /cn/
75Allow: /CN$
76Allow: /CN/
77Allow: /assets/
78Allow: /static/
79Allow: /styleguide/
80Disallow: */w?q=
81Disallow: */w/?q=
82Disallow: /
83
84Sitemap: https://www.nike.com/sitemap-us-help.xml
85Sitemap: https://www.nike.com/sitemap-v2-landingpage-index.xml
86Sitemap: https://www.nike.com/sitemap-v2-pdp-index.xml
87Sitemap: https://www.nike.com/sitemap-v2-snkrsweb-index.xml
88Sitemap: https://www.nike.com/sitemap-v2-gridwall-index.xml
89Sitemap: https://www.nike.com/sitemap-v2-article-index.xml
90Sitemap: https://www.nike.com/sitemap-locator-index.xml
91
92#
93# `` ```.`
94# `+/ ``.-/+o+:-.
95# `/mo ``.-:+syhdhs/-`
96# -hMd `..:+oyhmNNmds/-`
97# `oNMM/ ``.-/oyhdmMMMMNdy+:.
98# .hMMMM- `.-/+shdmNMMMMMMNdy+:.
99# :mMMMMM+ `.-:+sydmNMMMMMMMMMNmho:.`
100# :NMMMMMMN: `.-:/oyhmmNMMMMMMMMMMMNmho:.`
101# .NMMMMMMMMNy:` `.-/oshdmNMMMMMMMMMMMMMMMmhs/-`
102# hMMMMMMMMMMMMmhysooosyhdmNMMMMMMMMMMMMMMMMMMmds/-`
103# .MMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMNdy+-.`
104# -MMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMNdy+-.`
105# `NMMMMMMMMMMMMMMMMMMMMMMMMMMMMMmyo:.`
106# /NMMMMMMMMMMMMMMMMMMMMMMMmho:.`
107# .yNMMMMMMMMMMMMMMMMmhs/.`
108# ./shdmNNmmdhyo/-``
109# `````