NeuralCrawl

Together AI / robots.txt snapshot

← back to together.ai · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 358 bytes · sha256 ba7311868a97779b · raw

final URL: https://www.together.ai/robots.txt

1# -----------------------------
2# Global rules (apply to all crawlers)
3# -----------------------------
4User-agent: *
5Allow: /
6
7# -----------------------------
8# Google (block AI training only)
9# -----------------------------
10User-agent: Google-Extended
11Disallow: /
12
13Sitemap: https://docs.together.ai/sitemap.xml
14
15Sitemap: https://www.together.ai/sitemap.xml