NeuralCrawl

Scale AI / robots.txt

← back to scale.com · change detected 6d ago (2026-07-30T23:00:57Z) · modified +1 −0

What changed

Diff old (2026-06-20T01:10:30Z)new (2026-07-30T23:00:57Z)

@@ -1,6 +1,7 @@
11  # *
22  User-agent: *
33  Allow: /
4+ Allow: /api/og
45  Disallow: /studio
56  Disallow: /studio/*
67  Disallow: /draft