NeuralCrawl

Exa / robots.txt snapshot

← back to exa.ai · fetched 2026-10-29T17:28:06Z (8d ago) · HTTP 200 · 1871 bytes · sha256 03a085efb4ed1805 · raw

final URL: https://exa.ai/robots.txt

1User-Agent: *
2Content-Signal: search=yes, ai-input=yes, ai-train=yes
3Allow: /library$
4Allow: /library/$
5Allow: /library?
6Allow: /library/person$
7Allow: /library/person/$
8Allow: /library/person?
9Allow: /library/organization$
10Allow: /library/organization/$
11Allow: /library/organization?
12Allow: /library/place$
13Allow: /library/place/$
14Allow: /library/place?
15Allow: /library/publication$
16Allow: /library/publication/$
17Allow: /library/publication?
18Allow: /library/legal/opinion$
19Allow: /library/legal/opinion/$
20Allow: /library/legal/opinion?
21Allow: /library/legal/patent$
22Allow: /library/legal/patent/$
23Allow: /library/legal/patent?
24Allow: /library/podcast$
25Allow: /library/podcast/$
26Allow: /library/podcast?
27Allow: /library/markets/stocks$
28Allow: /library/markets/stocks/$
29Allow: /library/markets/stocks?
30Allow: /library/markets$
31Allow: /library/markets/$
32Allow: /library/markets?
33Allow: /library/sports$
34Allow: /library/sports/$
35Allow: /library/sports?
36Allow: /library/weather$
37Allow: /library/weather/$
38Allow: /library/weather?
39Allow: /library/indicator$
40Allow: /library/indicator/$
41Allow: /library/indicator?
42Allow: /library/geoarea$
43Allow: /library/geoarea/$
44Allow: /library/geoarea?
45Allow: /library/earnings-call$
46Allow: /library/earnings-call/$
47Allow: /library/earnings-call?
48Allow: /library/job-posting$
49Allow: /library/job-posting/$
50Allow: /library/job-posting?
51Allow: /library/product$
52Allow: /library/product/$
53Allow: /library/product?
54Allow: /library/event$
55Allow: /library/event/$
56Allow: /library/event?
57Allow: /library/wikipedia-article$
58Allow: /library/wikipedia-article/$
59Allow: /library/wikipedia-article?
60Allow: /library/sec-filing$
61Allow: /library/sec-filing/$
62Allow: /library/sec-filing?
63Disallow: /search?*
64Disallow: /hackathon/
65Disallow: /library/*/
66Disallow: /library/places
67
68Sitemap: https://exa.ai/sitemap.xml
69Sitemap: https://exa.ai/docs/sitemap.xml