Runway / robots.txt snapshot
← back to runwayml.com · fetched 2026-09-09T18:36:35Z (1mo ago) · HTTP 200 · 431 bytes · sha256 8ff37ee8306f335d · raw
final URL: https://runway.com/robots.txt
| 1 | User-agent: * |
| 2 | Allow: / |
| 3 | |
| 4 | # Gated assets. The landing pages at /reports/<slug> are indexable; the PDFs |
| 5 | # they give away are not. Each download response also carries an |
| 6 | # `X-Robots-Tag: noindex` header, which is the enforcing half — this rule just |
| 7 | # keeps well-behaved crawlers from spending requests on an endpoint that |
| 8 | # answers 404 without a form submission. |
| 9 | Disallow: /api/gated-resource/ |
| 10 | |
| 11 | Sitemap: https://runway.com/sitemap.xml |