NeuralCrawl

Pixiv / robots.txt

← back to pixiv.net · change detected 29d ago (2026-10-09T04:09:04Z) · modified +0 −7

What changed

Diff old (2026-06-20T01:10:31Z) → new (2026-10-09T04:09:04Z)

@@ -6,27 +6,20 @@
66  Disallow: /?return_to=
77  Disallow: /login.php?return_to=
88  Disallow: /index.php?return_to=
9-
109  Disallow: /artworks/unlisted/*
11-
1210  Disallow: /users/*/followers
1311  Disallow: /users/*/mypixiv
1412  Disallow: /users/*/bookmarks
1513  Disallow: /novel/comments.php?id=
1614  Disallow: /novels/unlisted/*
17-
1815  Disallow: /en/group
19-
2016  Disallow: /en/search/
21-
2217  Disallow: /en/users/*/followers
2318  Disallow: /en/users/*/mypixiv
2419  Disallow: /en/users/*/bookmarks
2520  Disallow: /en/novel/comments.php?id=
26-
2721  Disallow: /fanbox/search
2822  Disallow: /fanbox/tag
29-
3023  Allow: /comic-indies/$
3124  Allow: /comic-indies/about
3225  Disallow: /comic-indies/