NeuralCrawl

Exa / robots.txt snapshot

← back to exa.ai · fetched 2026-10-29T23:30:26Z (8d ago) · HTTP 200 · 4214 bytes · sha256 54ed0012adba8e20 · raw

final URL: https://exa.ai/robots.txt

1User-Agent: *
2Content-Signal: search=yes, ai-input=yes
3Content-Signal: /docs search=yes, ai-input=yes, ai-train=yes
4Content-Signal: /llms.txt search=yes, ai-input=yes, ai-train=yes
5Content-Signal: /llms-full.txt search=yes, ai-input=yes, ai-train=yes
6Content-Signal: /index.md search=yes, ai-input=yes, ai-train=yes
7Content-Signal: /100049 search=yes, ai-input=yes, ai-train=yes
8Content-Signal: /100083 search=yes, ai-input=yes, ai-train=yes
9Content-Signal: /about search=yes, ai-input=yes, ai-train=yes
10Content-Signal: /ai-writing-assistant search=yes, ai-input=yes, ai-train=yes
11Content-Signal: /alternatives search=yes, ai-input=yes, ai-train=yes
12Content-Signal: /bing-api-alternative-exa search=yes, ai-input=yes, ai-train=yes
13Content-Signal: /bing-api-deprecation search=yes, ai-input=yes, ai-train=yes
14Content-Signal: /blog search=yes, ai-input=yes, ai-train=yes
15Content-Signal: /brand search=yes, ai-input=yes, ai-train=yes
16Content-Signal: /careers search=yes, ai-input=yes, ai-train=yes
17Content-Signal: /claude search=yes, ai-input=yes, ai-train=yes
18Content-Signal: /connect search=yes, ai-input=yes, ai-train=yes
19Content-Signal: /contact search=yes, ai-input=yes, ai-train=yes
20Content-Signal: /customers search=yes, ai-input=yes, ai-train=yes
21Content-Signal: /demos search=yes, ai-input=yes, ai-train=yes
22Content-Signal: /dpa search=yes, ai-input=yes, ai-train=yes
23Content-Signal: /enterprise search=yes, ai-input=yes, ai-train=yes
24Content-Signal: /evals search=yes, ai-input=yes, ai-train=yes
25Content-Signal: /exa-for-sheets search=yes, ai-input=yes, ai-train=yes
26Content-Signal: /integrations search=yes, ai-input=yes, ai-train=yes
27Content-Signal: /mcp search=yes, ai-input=yes, ai-train=yes
28Content-Signal: /msa search=yes, ai-input=yes, ai-train=yes
29Content-Signal: /partners search=yes, ai-input=yes, ai-train=yes
30Content-Signal: /pricing search=yes, ai-input=yes, ai-train=yes
31Content-Signal: /privacy-policy search=yes, ai-input=yes, ai-train=yes
32Content-Signal: /products search=yes, ai-input=yes, ai-train=yes
33Content-Signal: /research search=yes, ai-input=yes, ai-train=yes
34Content-Signal: /security search=yes, ai-input=yes, ai-train=yes
35Content-Signal: /use-cases search=yes, ai-input=yes, ai-train=yes
36Content-Signal: /versus search=yes, ai-input=yes, ai-train=yes
37Content-Signal: /webinars search=yes, ai-input=yes, ai-train=yes
38Content-Signal: /why search=yes, ai-input=yes, ai-train=yes
39Allow: /library$
40Allow: /library/$
41Allow: /library?
42Allow: /library/person$
43Allow: /library/person/$
44Allow: /library/person?
45Allow: /library/organization$
46Allow: /library/organization/$
47Allow: /library/organization?
48Allow: /library/place$
49Allow: /library/place/$
50Allow: /library/place?
51Allow: /library/publication$
52Allow: /library/publication/$
53Allow: /library/publication?
54Allow: /library/legal/opinion$
55Allow: /library/legal/opinion/$
56Allow: /library/legal/opinion?
57Allow: /library/legal/patent$
58Allow: /library/legal/patent/$
59Allow: /library/legal/patent?
60Allow: /library/podcast$
61Allow: /library/podcast/$
62Allow: /library/podcast?
63Allow: /library/markets/stocks$
64Allow: /library/markets/stocks/$
65Allow: /library/markets/stocks?
66Allow: /library/markets$
67Allow: /library/markets/$
68Allow: /library/markets?
69Allow: /library/sports$
70Allow: /library/sports/$
71Allow: /library/sports?
72Allow: /library/weather$
73Allow: /library/weather/$
74Allow: /library/weather?
75Allow: /library/indicator$
76Allow: /library/indicator/$
77Allow: /library/indicator?
78Allow: /library/geoarea$
79Allow: /library/geoarea/$
80Allow: /library/geoarea?
81Allow: /library/earnings-call$
82Allow: /library/earnings-call/$
83Allow: /library/earnings-call?
84Allow: /library/job-posting$
85Allow: /library/job-posting/$
86Allow: /library/job-posting?
87Allow: /library/product$
88Allow: /library/product/$
89Allow: /library/product?
90Allow: /library/event$
91Allow: /library/event/$
92Allow: /library/event?
93Allow: /library/wikipedia-article$
94Allow: /library/wikipedia-article/$
95Allow: /library/wikipedia-article?
96Allow: /library/sec-filing$
97Allow: /library/sec-filing/$
98Allow: /library/sec-filing?
99Disallow: /search?*
100Disallow: /hackathon/
101Disallow: /library/*/
102Disallow: /library/places
103
104Sitemap: https://exa.ai/sitemap.xml
105Sitemap: https://exa.ai/docs/sitemap.xml