NeuralCrawl

Kimberly-Clark / robots.txt snapshot

← back to kimberly-clark.com · fetched 2026-06-20T01:10:31Z (18h ago) · HTTP 200 · 1200 bytes · sha256 75437f9f2194d7df · raw

final URL: https://www.kimberly-clark.com/robots.txt

1# Allow AI search and agent use
2User-agent: OAI-SearchBot
3User-agent: GPTBot
4User-agent: ChatGPT-User
5User-agent: PerplexityBot
6User-agent: FirecrawlAgent
7User-agent: AndiBot
8User-agent: ExaBot
9User-agent: PhindBot
10User-agent: YouBot
11User-agent: RAG bots
12User-agent: Inference bots
13User-agent: Google-Extended
14User-agent: ChatGPT-User
15User-agent: QAI-SearchBot
16Allow: /
17
18# Disallow AI training data collection
19User-agent: ClaudeBot
20User-agent: CCBot
21User-agent: Bytespider
22User-agent: ChatGPT
23Disallow: /
24
25# Allow traditional search indexing
26User-agent: Googlebot
27User-agent: Bingbot
28Allow: /
29
30Sitemap: https://www.kimberly-clark.com/en-vn/sitemap.xml
31Sitemap: https://www.kimberly-clark.com/en-us/sitemap.xml
32Sitemap: https://www.kimberly-clark.com/es-us/sitemap.xml
33Sitemap: https://www.kimberly-clark.com/en-ca/sitemap.xml
34Sitemap: https://www.kimberly-clark.com/fr-ca/sitemap.xml
35Sitemap: https://www.kimberly-clark.com/pt-br/sitemap.xml
36Sitemap: https://www.kimberly-clark.com/en-au/sitemap.xml
37Sitemap: https://www.kimberly-clark.com/ru-ru/sitemap.xml
38Sitemap: https://www.kimberly-clark.com/uk-ua/sitemap.xml
39Sitemap: https://www.kimberly-clark.com/zh-tw/sitemap.xml