NeuralCrawl

Pixiv / robots.txt

← back to pixiv.net · change detected 8d ago (2026-10-30T05:39:55Z) · modified +1 −0

What changed

Diff old (2026-10-09T04:09:04Z) → new (2026-10-30T05:39:55Z)

@@ -36,4 +36,5 @@
3636  User-Agent: omgili
3737  User-Agent: Diffbot
3838  User-Agent: omgilibot
39+ Allow: /info.php
3940  Disallow: /