NeuralCrawl

EPFL / robots.txt

← back to epfl.ch · change detected 1mo ago (2026-07-02T00:38:22Z) · modified +2 −1

What changed

Diff old (2026-06-26T14:15:22Z)new (2026-07-02T00:38:22Z)

@@ -18,6 +18,7 @@
1818  # augmented generation, grounding, or other real-time taking of content for
1919  # generative AI search answers).
2020  # ai-train: training or fine-tuning AI models.
21+ # use: how AI systems may consume the content (immediate, reference, or full).
2122 
2223  # ANY RESTRICTIONS EXPRESSED VIA CONTENT SIGNALS ARE EXPRESS RESERVATIONS OF
2324  # RIGHTS UNDER ARTICLE 4 OF THE EUROPEAN UNION DIRECTIVE 2019/790 ON COPYRIGHT
@@ -26,7 +27,7 @@
2627  # BEGIN Cloudflare Managed content
2728 
2829  User-agent: *
29- Content-Signal: search=yes,ai-train=no
30+ Content-Signal: search=yes,ai-train=no,use=reference
3031  Allow: /
3132 
3233  User-agent: Amazonbot