NeuralCrawl

Apple / robots.txt snapshot

← back to apple.com · fetched 2026-06-20T01:10:30Z (17h ago) · HTTP 200 · 1018 bytes · sha256 3115f45c98cfa193 · raw

final URL: https://www.apple.com/robots.txt

1# robots.txt for https://www.apple.com/
2
3User-agent: *
4Disallow: /*shop/browse/overlay/*
5Disallow: /*shop/iphone/payments/overlay/*
6Disallow: /cn/*/aow/*
7Disallow: /tmall*
8Allow: /ac/globalnav/2.0/*/images/ac-globalnav/globalnav/search/*
9
10User-agent: Baiduspider
11Disallow: /*
12Allow: /cn/*
13Allow: /cn-edu/*
14Allow: /cn-k12/*
15
16User-agent: HaoSouSpider
17Disallow: /*
18Allow: /cn/*
19Allow: /cn-edu/*
20Allow: /cn-k12/*
21
22User-agent: Sogou web spider
23Disallow: /*
24Allow: /cn/*
25Allow: /cn-k12/*
26
27User-agent: Sogou inst spider
28Disallow: /*
29Allow: /cn/*
30Allow: /cn-k12/*
31
32User-agent: Sogou spider2
33Disallow: /*
34Allow: /cn/*
35Allow: /cn-k12/*
36
37#DaumWebMasterTool:6ff40e0f09564a9d4e3bc80e7cbde7c196677a2f5f610eb9c029836774f9a8e9:D9a8IEFAzmC/NWsQ3tB0Wg==
38
39Sitemap: https://www.apple.com/shop/sitemap.xml
40Sitemap: https://www.apple.com/autopush/sitemap/sitemap-index.xml
41Sitemap: https://www.apple.com/newsroom/sitemap.xml
42Sitemap: https://www.apple.com/retail/sitemap/sitemap.xml
43Sitemap: https://www.apple.com/today/sitemap-index.xml