Project Gutenberg / robots.txt snapshot
← back to gutenberg.org · fetched 2026-06-20T01:10:31Z (15h ago) · HTTP 200 · 40 bytes · sha256 1f9a3a7eb83eff1e · raw
final URL: https://gutenberg.org/robots.txt
| 1 | User-agent: * |
| 2 | Disallow: /ebooks/search |
| 3 |
← back to gutenberg.org · fetched 2026-06-20T01:10:31Z (15h ago) · HTTP 200 · 40 bytes · sha256 1f9a3a7eb83eff1e · raw
final URL: https://gutenberg.org/robots.txt
| 1 | User-agent: * |
| 2 | Disallow: /ebooks/search |
| 3 |