NeuralCrawl

Snyk / robots.txt

← back to snyk.io · change detected 2mo ago (2026-08-21T18:25:56Z) · modified +1 −0

What changed

Diff old (2026-06-20T14:27:25Z) → new (2026-08-21T18:25:56Z)

@@ -1,6 +1,7 @@
11  # *
22  User-agent: *
33  Allow: /
4+ Content-Signal: ai-train=no, search=yes, ai-input=yes
45 
56  # *
67  User-agent: *