Hacker News / robots.txt snapshot
← back to news.ycombinator.com · fetched 2026-09-10T06:41:03Z (1mo ago) · HTTP 200 · 316 bytes · sha256 bb1bc7388dcfaf7c · raw
final URL: https://news.ycombinator.com/robots.txt
| 1 | User-Agent: * |
| 2 | Crawl-delay: 30 |
| 3 | Disallow: /collapse? |
| 4 | Disallow: /context? |
| 5 | Disallow: /fave? |
| 6 | Disallow: /favex? |
| 7 | Disallow: /flag? |
| 8 | Disallow: /hide? |
| 9 | Disallow: /login |
| 10 | Disallow: /loginx |
| 11 | Disallow: /logout |
| 12 | Disallow: /r? |
| 13 | Disallow: /reply? |
| 14 | Disallow: /replyx? |
| 15 | Disallow: /submitlink? |
| 16 | Disallow: /vote? |
| 17 | Disallow: /votex? |
| 18 | Disallow: /x? |