NeuralCrawl

PyPI / robots.txt snapshot

← back to pypi.org · fetched 2026-06-20T01:10:31Z (15h ago) · HTTP 200 · 325 bytes · sha256 fd0059b266de42bd · raw

final URL: https://pypi.org/robots.txt

1Sitemap: https://pypi.org/sitemap.xml
2
3User-agent: *
4Disallow: /simple/
5Disallow: /packages/
6Disallow: /_includes/authed/
7Disallow: /project/*/submit-malware-report/
8Disallow: /pypi/*/json
9Disallow: /pypi/*/*/json
10Disallow: /pypi*?
11Disallow: /search*
12Disallow: /_/
13Disallow: /integrity/
14Disallow: /account/
15Disallow: /admin/