Ukraine (KMU) / robots.txt
← back to kmu.gov.ua · change detected 1mo ago (2026-07-03T13:16:54Z) · modified +9 −0
What changed
- Added Disallow: *utm= for *
- Added Disallow: /api/ for *
- Added Disallow: /backend/ for *
- Added Disallow: /timeline for *
- Crawl-delay for *: none → 1
- Added sitemap https://www.kmu.gov.ua/sitemap.xml
Diff old (2026-07-02T18:55:39Z) → new (2026-07-03T13:16:54Z)
| @@ -1,2 +1,11 @@ | ||
| 1 | 1 | User-agent: * |
| 2 | + Disallow: /backend/ | |
| 3 | + Disallow: /api/ | |
| 4 | + Disallow: *utm= | |
| 5 | + Disallow: /timeline | |
| 2 | 6 | Disallow: /storage/ |
| 7 | + Host: www.kmu.gov.ua | |
| 8 | + Crawl-delay: 1 | |
| 9 | + Request-rate: 1/1 | |
| 10 | + Clean-param: utm_source&utm_medium&utm_campaign | |
| 11 | + Sitemap: https://www.kmu.gov.ua/sitemap.xml |