NeuralCrawl

Yahoo / robots.txt snapshot

← back to yahoo.co.jp · fetched 2026-06-26T13:23:15Z (3h ago) · HTTP 200 · 87 bytes · sha256 d0e013f7c6a36fdf · raw

final URL: https://www.yahoo.co.jp/robots.txt

1User-agent: Google-Extended
2Disallow: /
3
4User-agent: GPTBot
5Disallow: /
6
7User-agent: *