NeuralCrawl

Exa / robots.txt snapshot

← back to exa.ai · fetched 2026-10-30T05:39:55Z (8d ago) · HTTP 200 · 4278 bytes · sha256 cb4d5e6612ec5431 · raw

final URL: https://exa.ai/robots.txt

1User-Agent: *
2Content-Signal: search=yes, ai-input=yes
3Content-Signal: /docs search=yes, ai-input=yes, ai-train=yes
4Content-Signal: /llms.txt search=yes, ai-input=yes, ai-train=yes
5Content-Signal: /llms-full.txt search=yes, ai-input=yes, ai-train=yes
6Content-Signal: /auth.md search=yes, ai-input=yes, ai-train=yes
7Content-Signal: /index.md search=yes, ai-input=yes, ai-train=yes
8Content-Signal: /100049 search=yes, ai-input=yes, ai-train=yes
9Content-Signal: /100083 search=yes, ai-input=yes, ai-train=yes
10Content-Signal: /about search=yes, ai-input=yes, ai-train=yes
11Content-Signal: /ai-writing-assistant search=yes, ai-input=yes, ai-train=yes
12Content-Signal: /alternatives search=yes, ai-input=yes, ai-train=yes
13Content-Signal: /bing-api-alternative-exa search=yes, ai-input=yes, ai-train=yes
14Content-Signal: /bing-api-deprecation search=yes, ai-input=yes, ai-train=yes
15Content-Signal: /blog search=yes, ai-input=yes, ai-train=yes
16Content-Signal: /brand search=yes, ai-input=yes, ai-train=yes
17Content-Signal: /careers search=yes, ai-input=yes, ai-train=yes
18Content-Signal: /claude search=yes, ai-input=yes, ai-train=yes
19Content-Signal: /connect search=yes, ai-input=yes, ai-train=yes
20Content-Signal: /contact search=yes, ai-input=yes, ai-train=yes
21Content-Signal: /customers search=yes, ai-input=yes, ai-train=yes
22Content-Signal: /demos search=yes, ai-input=yes, ai-train=yes
23Content-Signal: /dpa search=yes, ai-input=yes, ai-train=yes
24Content-Signal: /enterprise search=yes, ai-input=yes, ai-train=yes
25Content-Signal: /evals search=yes, ai-input=yes, ai-train=yes
26Content-Signal: /exa-for-sheets search=yes, ai-input=yes, ai-train=yes
27Content-Signal: /integrations search=yes, ai-input=yes, ai-train=yes
28Content-Signal: /mcp search=yes, ai-input=yes, ai-train=yes
29Content-Signal: /msa search=yes, ai-input=yes, ai-train=yes
30Content-Signal: /partners search=yes, ai-input=yes, ai-train=yes
31Content-Signal: /pricing search=yes, ai-input=yes, ai-train=yes
32Content-Signal: /privacy-policy search=yes, ai-input=yes, ai-train=yes
33Content-Signal: /products search=yes, ai-input=yes, ai-train=yes
34Content-Signal: /research search=yes, ai-input=yes, ai-train=yes
35Content-Signal: /security search=yes, ai-input=yes, ai-train=yes
36Content-Signal: /use-cases search=yes, ai-input=yes, ai-train=yes
37Content-Signal: /versus search=yes, ai-input=yes, ai-train=yes
38Content-Signal: /webinars search=yes, ai-input=yes, ai-train=yes
39Content-Signal: /why search=yes, ai-input=yes, ai-train=yes
40Allow: /library$
41Allow: /library/$
42Allow: /library?
43Allow: /library/person$
44Allow: /library/person/$
45Allow: /library/person?
46Allow: /library/organization$
47Allow: /library/organization/$
48Allow: /library/organization?
49Allow: /library/place$
50Allow: /library/place/$
51Allow: /library/place?
52Allow: /library/publication$
53Allow: /library/publication/$
54Allow: /library/publication?
55Allow: /library/legal/opinion$
56Allow: /library/legal/opinion/$
57Allow: /library/legal/opinion?
58Allow: /library/legal/patent$
59Allow: /library/legal/patent/$
60Allow: /library/legal/patent?
61Allow: /library/podcast$
62Allow: /library/podcast/$
63Allow: /library/podcast?
64Allow: /library/markets/stocks$
65Allow: /library/markets/stocks/$
66Allow: /library/markets/stocks?
67Allow: /library/markets$
68Allow: /library/markets/$
69Allow: /library/markets?
70Allow: /library/sports$
71Allow: /library/sports/$
72Allow: /library/sports?
73Allow: /library/weather$
74Allow: /library/weather/$
75Allow: /library/weather?
76Allow: /library/indicator$
77Allow: /library/indicator/$
78Allow: /library/indicator?
79Allow: /library/geoarea$
80Allow: /library/geoarea/$
81Allow: /library/geoarea?
82Allow: /library/earnings-call$
83Allow: /library/earnings-call/$
84Allow: /library/earnings-call?
85Allow: /library/job-posting$
86Allow: /library/job-posting/$
87Allow: /library/job-posting?
88Allow: /library/product$
89Allow: /library/product/$
90Allow: /library/product?
91Allow: /library/event$
92Allow: /library/event/$
93Allow: /library/event?
94Allow: /library/wikipedia-article$
95Allow: /library/wikipedia-article/$
96Allow: /library/wikipedia-article?
97Allow: /library/sec-filing$
98Allow: /library/sec-filing/$
99Allow: /library/sec-filing?
100Disallow: /search?*
101Disallow: /hackathon/
102Disallow: /library/*/
103Disallow: /library/places
104
105Sitemap: https://exa.ai/sitemap.xml
106Sitemap: https://exa.ai/docs/sitemap.xml