DataDome / robots.txt snapshot

← back to datadome.co · fetched 2026-06-27T17:18:59Z (1mo ago) · HTTP 200 · 576 bytes · sha256 c1cc9a7beb7dd6c9 · raw

final URL: https://datadome.co/robots.txt

1	User-Agent: *
2	Disallow: /wp-admin/
3	Allow: /wp-admin/admin-ajax.php
4
5	User-agent: Googlebot
6	Disallow: /*.md$
7
8	User-agent: Bingbot
9	Disallow: /*.md$
10
11	User-agent: GPTBot
12	Allow: /*.md$
13	Allow: /llms.txt
14
15	User-agent: ChatGPT-User
16	Allow: /*.md$
17	Allow: /llms.txt
18
19	User-agent: ClaudeBot
20	Allow: /*.md$
21	Allow: /llms.txt
22
23	User-agent: anthropic-ai
24	Allow: /*.md$
25	Allow: /llms.txt
26
27	User-agent: PerplexityBot
28	Allow: /*.md$
29	Allow: /llms.txt
30
31	User-agent: Google-Extended
32	Allow: /
33
34	User-agent: cohere-ai
35	Allow: /*.md$
36	Allow: /llms.txt
37
38	User-agent: Applebot-Extended
39	Allow: /*.md$
40	Allow: /llms.txt