Ukraine (KMU) / robots.txt
← back to kmu.gov.ua · change detected 1mo ago (2026-07-02T18:55:39Z) · modified +1 −12
What changed
- Added Disallow: /storage/ for *
- Removed Disallow: *utm= for *
- Removed Disallow: /api/ for *
- Removed Disallow: /backend/ for *
- Removed Disallow: /timeline for *
- Crawl-delay for *: 1 → none
- Removed sitemap https://www.kmu.gov.ua/sitemap.xml
Diff old (2026-06-20T01:10:30Z) → new (2026-07-02T18:55:39Z)
| @@ -1,13 +1,2 @@ | ||
| 1 | 1 | User-agent: * |
| 2 | - Disallow: /backend/ | |
| 3 | - Disallow: /api/ | |
| 4 | - Disallow: *utm= | |
| 5 | - Disallow: /timeline | |
| 6 | - Host: www.kmu.gov.ua | |
| 7 | - Crawl-delay: 1 | |
| 8 | - Request-rate: 1/1 | |
| 9 | - # Visit-time: | |
| 10 | - Clean-param: utm_source&utm_medium&utm_campaign | |
| 11 | - # v.1.2 | |
| 12 | - | |
| 13 | - Sitemap: https://www.kmu.gov.ua/sitemap.xml | |
| 2 | + Disallow: /storage/ |