Finland (Valtioneuvosto) / robots.txt snapshot
← back to valtioneuvosto.fi · fetched 2026-06-23T12:33:52Z (1mo ago) · HTTP 200 · 283 bytes · sha256 4b36419447301c66 · raw
final URL: manual:file
| 1 | User-agent: AhrefsBot |
| 2 | Disallow: / |
| 3 | |
| 4 | User-Agent: MJ12bot |
| 5 | Disallow: / |
| 6 | |
| 7 | User-agent: SemrushBot |
| 8 | Disallow: / |
| 9 | |
| 10 | user-agent: * |
| 11 | disallow: /-/q/ |
| 12 | disallow: /haku/ |
| 13 | disallow: /sok/ |
| 14 | disallow: /search/ |
| 15 | disallow: /web/ |
| 16 | disallow: /*/web/ |
| 17 | crawl-delay: 5 |
| 18 | |
| 19 | sitemap: https://valtioneuvosto.fi/sitemap.xml |