Kuehne+Nagel / robots.txt snapshot

← back to kuehne-nagel.com · fetched 2026-08-06T13:18:41Z (3mo ago) · HTTP 200 · 510 bytes · sha256 eb7eb24b8ac6d7a1 · raw

final URL: https://www.kuehne-nagel.com/robots.txt

1	User-agent: *
2	Disallow: /editor/
3	Disallow: /?
4
5	User-agent: Applebot
6	crawl-delay: 5
7
8	User-agent: YisouSpider
9	disallow: /*
10	allow: /cn/*
11	crawl-delay: 10
12
13	User-agent: Sogou web spider
14	disallow: /*
15	allow: /cn/*
16	crawl-delay: 10
17
18	User-agent: BaiduSpider
19	disallow: /*
20	allow: /cn/*
21	crawl-delay: 5
22
23	User-agent: amazon-Qbusiness
24	crawl-delay: 10
25
26	User-agent: GPTBot
27	crawl-delay: 5
28
29	User-agent: Bytespider
30	disallow: /*
31
32	User-agent: SERankingBacklinksBot
33	crawl-delay: 5
34
35	Sitemap: https://www.kuehne-nagel.com/sitemap.xml
36