NeuralCrawl

Hacker News / robots.txt

← back to news.ycombinator.com · change detected 1mo ago (2026-09-11T07:04:32Z) · modified +0 −4

What changed

Diff old (2026-09-10T06:41:03Z) → new (2026-09-11T07:04:32Z)

@@ -3,16 +3,12 @@
33  Disallow: /collapse?
44  Disallow: /context?
55  Disallow: /fave?
6- Disallow: /favex?
76  Disallow: /flag?
87  Disallow: /hide?
98  Disallow: /login
10- Disallow: /loginx
119  Disallow: /logout
1210  Disallow: /r?
1311  Disallow: /reply?
14- Disallow: /replyx?
1512  Disallow: /submitlink?
1613  Disallow: /vote?
17- Disallow: /votex?
1814  Disallow: /x?