Hacker News / robots.txt snapshot
← back to news.ycombinator.com · fetched 2026-06-20T01:10:31Z (15h ago) · HTTP 200 · 243 bytes · sha256 2391981cd9331481 · raw
final URL: https://news.ycombinator.com/robots.txt
| 1 | User-Agent: * |
| 2 | Crawl-delay: 30 |
| 3 | Disallow: /collapse? |
| 4 | Disallow: /context? |
| 5 | Disallow: /fave? |
| 6 | Disallow: /flag? |
| 7 | Disallow: /hide? |
| 8 | Disallow: /login |
| 9 | Disallow: /logout |
| 10 | Disallow: /r? |
| 11 | Disallow: /reply? |
| 12 | Disallow: /submitlink? |
| 13 | Disallow: /vote? |
| 14 | Disallow: /x? |