Crossref / robots.txt snapshot
← back to crossref.org · fetched 2026-06-26T14:15:22Z (4h ago) · HTTP 200 · 118 bytes · sha256 d9ed1ea62cb672c5 · raw
final URL: https://crossref.org/robots.txt
| 1 | User-agent: * |
| 2 | Allow: / |
| 3 | Disallow: /_ |
| 4 | Disallow: /help/_ |
| 5 | Disallow: /apply/ |
| 6 | Sitemap: https://www.crossref.org/sitemap.xml |