Runway / robots.txt snapshot
← back to runwayml.com · fetched 2026-09-15T14:34:35Z (1mo ago) · HTTP 200 · 664 bytes · sha256 94cb7d711b21c2af · raw
final URL: https://runway.com/robots.txt
| 1 | User-agent: * |
| 2 | Allow: / |
| 3 | |
| 4 | # Gated assets. The landing pages at /reports/<slug> are indexable; the PDFs |
| 5 | # they give away are not. Each download response also carries an |
| 6 | # `X-Robots-Tag: noindex` header, which is the enforcing half — this rule just |
| 7 | # keeps well-behaved crawlers from spending requests on an endpoint that |
| 8 | # answers 404 without a form submission. |
| 9 | Disallow: /api/gated-resource/ |
| 10 | |
| 11 | # Hosted files (/files/<slug>, Sanity `hostedFile`) are deliberately NOT listed |
| 12 | # here: each is noindex or indexable per document, carried as an X-Robots-Tag on |
| 13 | # its own response, and a blanket Disallow would override that opt-in. |
| 14 | |
| 15 | Sitemap: https://runway.com/sitemap.xml |