Startpage / robots.txt snapshot
← back to startpage.com · fetched 2026-06-20T14:56:27Z (4h ago) · HTTP 200 · 188 bytes · sha256 795bee4d79cfc811 · raw
final URL: https://www.startpage.com/robots.txt
| 1 | User-agent: * |
| 2 | Allow: /sp/cdn/images/ |
| 3 | Allow: /sp/cdn/favicons/ |
| 4 | Disallow: /cgi-bin/ |
| 5 | Disallow: /do/ |
| 6 | Disallow: /sp/ |
| 7 | Disallow: /av/ |
| 8 | Noindex: /cgi-bin/ |
| 9 | Noindex: /do/ |
| 10 | Noindex: /sp/ |
| 11 | Noindex: /av/ |