Runway / robots.txt
← back to runwayml.com · change detected 1mo ago (2026-09-09T18:36:35Z) · modified +7 −0
What changed
- Added Disallow: /api/gated-resource/ for *
Diff old (2026-07-23T20:15:59Z) → new (2026-09-09T18:36:35Z)
| @@ -1,4 +1,11 @@ | ||
| 1 | 1 | User-agent: * |
| 2 | 2 | Allow: / |
| 3 | 3 | |
| 4 | + # Gated assets. The landing pages at /reports/<slug> are indexable; the PDFs | |
| 5 | + # they give away are not. Each download response also carries an | |
| 6 | + # `X-Robots-Tag: noindex` header, which is the enforcing half — this rule just | |
| 7 | + # keeps well-behaved crawlers from spending requests on an endpoint that | |
| 8 | + # answers 404 without a form submission. | |
| 9 | + Disallow: /api/gated-resource/ | |
| 10 | + | |
| 4 | 11 | Sitemap: https://runway.com/sitemap.xml |