Bluesky / robots.txt snapshot
← back to bsky.app · fetched 2026-06-20T01:10:30Z (15h ago) · HTTP 200 · 415 bytes · sha256 5c6c950ccfb17d9b · raw
final URL: https://bsky.app/robots.txt
| 1 | # Hello Friends! |
| 2 | # If you are considering bulk or automated crawling, you may want to look in |
| 3 | # to our protocol (API), including a firehose of updates. See: https://atproto.com/ |
| 4 | |
| 5 | # By default, may crawl anything on this domain. HTTP 429 ("backoff") status |
| 6 | # codes are used for rate-limiting. Up to a handful concurrent requests should |
| 7 | # be ok. |
| 8 | User-Agent: * |
| 9 | Allow: / |
| 10 | |
| 11 | Sitemap: https://bsky.app/sitemap/users.xml.gz |