NeuralCrawl

xAI / robots.txt

← back to x.ai · change detected 2mo ago (2026-08-28T02:24:20Z) · modified +2 −0

What changed

Diff old (2026-06-20T01:10:30Z) → new (2026-08-28T02:24:20Z)

@@ -16,3 +16,5 @@
1616  # Content Signals (draft) — declare AI/search usage preferences
1717  # See: https://contentsignals.org/
1818  Content-Signal: ai-train=no, search=yes, ai-input=no
19+ # Guides are written to be cited; allow answer-engine input on this tree only.
20+ Content-Signal: /bot/guides ai-train=no, search=yes, ai-input=yes