Stripe / robots.txt snapshot
← back to stripe.com · fetched 2026-06-20T01:10:30Z (19h ago) · HTTP 200 · 643 bytes · sha256 23166bdd2477d69a · raw
final URL: https://stripe.com/robots.txt
| 1 | Sitemap: https://stripe.com/sitemap/sitemap.xml |
| 2 | |
| 3 | User-agent: ia_archiver |
| 4 | Allow: /docs/api |
| 5 | Allow: /docs/api$ |
| 6 | Disallow: /docs |
| 7 | Disallow: /docs$ |
| 8 | Disallow: /bitcoin/refund |
| 9 | Disallow: /sources/refund |
| 10 | Disallow: /sources/sepa_mandate |
| 11 | Disallow: /sources/test_source |
| 12 | Disallow: /sources/test_klarna |
| 13 | Disallow: /handoff-healthcheck |
| 14 | Disallow: /handoff |
| 15 | |
| 16 | User-agent: * |
| 17 | Allow: /docs |
| 18 | Allow: /docs$ |
| 19 | Disallow: /bitcoin/refund |
| 20 | Disallow: /sources/refund |
| 21 | Disallow: /sources/sepa_mandate |
| 22 | Disallow: /sources/test_source |
| 23 | Disallow: /sources/test_klarna |
| 24 | Disallow: /unsupported-browser |
| 25 | Disallow: /handoff-healthcheck |
| 26 | Disallow: /handoff |
| 27 | |
| 28 | User-agent: rogerbot |
| 29 | Crawl-delay: 2 |