NeuralCrawl

Exa / robots.txt

← back to exa.ai · change detected 8d ago (2026-10-29T23:30:26Z) · modified +37 −1

What changed

Diff old (2026-10-29T17:28:06Z) → new (2026-10-29T23:30:26Z)

@@ -1,5 +1,41 @@
11  User-Agent: *
2- Content-Signal: search=yes, ai-input=yes, ai-train=yes
2+ Content-Signal: search=yes, ai-input=yes
3+ Content-Signal: /docs search=yes, ai-input=yes, ai-train=yes
4+ Content-Signal: /llms.txt search=yes, ai-input=yes, ai-train=yes
5+ Content-Signal: /llms-full.txt search=yes, ai-input=yes, ai-train=yes
6+ Content-Signal: /index.md search=yes, ai-input=yes, ai-train=yes
7+ Content-Signal: /100049 search=yes, ai-input=yes, ai-train=yes
8+ Content-Signal: /100083 search=yes, ai-input=yes, ai-train=yes
9+ Content-Signal: /about search=yes, ai-input=yes, ai-train=yes
10+ Content-Signal: /ai-writing-assistant search=yes, ai-input=yes, ai-train=yes
11+ Content-Signal: /alternatives search=yes, ai-input=yes, ai-train=yes
12+ Content-Signal: /bing-api-alternative-exa search=yes, ai-input=yes, ai-train=yes
13+ Content-Signal: /bing-api-deprecation search=yes, ai-input=yes, ai-train=yes
14+ Content-Signal: /blog search=yes, ai-input=yes, ai-train=yes
15+ Content-Signal: /brand search=yes, ai-input=yes, ai-train=yes
16+ Content-Signal: /careers search=yes, ai-input=yes, ai-train=yes
17+ Content-Signal: /claude search=yes, ai-input=yes, ai-train=yes
18+ Content-Signal: /connect search=yes, ai-input=yes, ai-train=yes
19+ Content-Signal: /contact search=yes, ai-input=yes, ai-train=yes
20+ Content-Signal: /customers search=yes, ai-input=yes, ai-train=yes
21+ Content-Signal: /demos search=yes, ai-input=yes, ai-train=yes
22+ Content-Signal: /dpa search=yes, ai-input=yes, ai-train=yes
23+ Content-Signal: /enterprise search=yes, ai-input=yes, ai-train=yes
24+ Content-Signal: /evals search=yes, ai-input=yes, ai-train=yes
25+ Content-Signal: /exa-for-sheets search=yes, ai-input=yes, ai-train=yes
26+ Content-Signal: /integrations search=yes, ai-input=yes, ai-train=yes
27+ Content-Signal: /mcp search=yes, ai-input=yes, ai-train=yes
28+ Content-Signal: /msa search=yes, ai-input=yes, ai-train=yes
29+ Content-Signal: /partners search=yes, ai-input=yes, ai-train=yes
30+ Content-Signal: /pricing search=yes, ai-input=yes, ai-train=yes
31+ Content-Signal: /privacy-policy search=yes, ai-input=yes, ai-train=yes
32+ Content-Signal: /products search=yes, ai-input=yes, ai-train=yes
33+ Content-Signal: /research search=yes, ai-input=yes, ai-train=yes
34+ Content-Signal: /security search=yes, ai-input=yes, ai-train=yes
35+ Content-Signal: /use-cases search=yes, ai-input=yes, ai-train=yes
36+ Content-Signal: /versus search=yes, ai-input=yes, ai-train=yes
37+ Content-Signal: /webinars search=yes, ai-input=yes, ai-train=yes
38+ Content-Signal: /why search=yes, ai-input=yes, ai-train=yes
339  Allow: /library$
440  Allow: /library/$
541  Allow: /library?