Grok / robots.txt snapshot

← back to grok.com · fetched 2026-06-27T10:55:50Z (3h ago) · HTTP 200 · 536 bytes · sha256 6cfbb82be1e367fc · raw

final URL: manual:file

1	User-Agent: *
2	Allow: /
3	Allow: /chat$
4	Allow: /chat/$
5	Allow: /c$
6	Allow: /c/$
7	Disallow: /rest
8	Disallow: /share-links
9	Disallow: /c/
10	Disallow: /chat/
11	Disallow: /project/*
12	Disallow: /_worker/*
13
14	User-Agent: GPTBot
15	User-Agent: ChatGPT-User
16	User-Agent: PerplexityBot
17	User-Agent: ClaudeBot
18	User-Agent: Google-Extended
19	User-Agent: Applebot-Extended
20	Allow: /$
21	Allow: /chat$
22	Allow: /code$
23	Allow: /highlights
24	Allow: /imagine
25	Allow: /plans$
26	Allow: /project$
27	Allow: /tasks$
28	Allow: /supergrok/imagine$
29	Disallow: /
30
31	Sitemap: https://grok.com/sitemap.xml