NeuralCrawl

Iceland (Government.is) / robots.txt snapshot

← back to government.is · fetched 2026-09-17T15:11:14Z (1d ago) · HTTP 200 · 2995 bytes · sha256 896c57b3c736f054 · raw

final URL: https://government.is/robots.txt

1User-agent: *
2Disallow: /page/a8cacb2b-3fa6-4b74-b51b-cf3f473a1933
3Disallow: /ministries/ministry-for-foreign-affairs/honorary-consuls/destination-iceland$
4Disallow: /ministries/ministry-for-foreign-affairs/honorary-consuls/destination-iceland?
5Disallow: /ministries/ministry-for-foreign-affairs/honorary-consuls/destination-iceland/$
6Disallow: /ministries/ministry-for-foreign-affairs/honorary-consuls/destination-iceland/?
7Disallow: /page/a17ab7d5-c496-47df-8b83-fd87b0003c42
8Disallow: /prufa$
9Disallow: /prufa?
10Disallow: /prufa/$
11Disallow: /prufa/?
12Disallow: /page/a286ef5a-b97c-4f58-96f6-fae663674dc1
13Disallow: /ministries/ministry-for-foreign-affairs/honorary-consuls/consular-services$
14Disallow: /ministries/ministry-for-foreign-affairs/honorary-consuls/consular-services?
15Disallow: /ministries/ministry-for-foreign-affairs/honorary-consuls/consular-services/$
16Disallow: /ministries/ministry-for-foreign-affairs/honorary-consuls/consular-services/?
17Disallow: /page/fcf5f9d8-fa0d-4b43-aa0d-0a014ebbedd2
18Disallow: /ministries/ministry-for-foreign-affairs/honorary-consuls$
19Disallow: /ministries/ministry-for-foreign-affairs/honorary-consuls?
20Disallow: /ministries/ministry-for-foreign-affairs/honorary-consuls/$
21Disallow: /ministries/ministry-for-foreign-affairs/honorary-consuls/?
22Disallow: /page/d382cd76-1f1c-41da-82bc-3c14593273d1
23Disallow: /search/bytags$
24Disallow: /search/bytags?
25Disallow: /search/bytags/$
26Disallow: /search/bytags/?
27Disallow: /page/e6bcbd6f-3827-4268-aa08-9b2568f4c936
28Disallow: /ministries/employees$
29Disallow: /ministries/employees?
30Disallow: /ministries/employees/$
31Disallow: /ministries/employees/?
32Disallow: /page/8583b52b-b0de-47c7-9397-5995b71c6761
33Disallow: /404$
34Disallow: /404?
35Disallow: /404/$
36Disallow: /404/?
37Disallow: /page/ec577559-aa02-45a6-829a-34405856097f
38Disallow: /ministries/ministry-for-foreign-affairs/honorary-consuls/consular-conferences$
39Disallow: /ministries/ministry-for-foreign-affairs/honorary-consuls/consular-conferences?
40Disallow: /ministries/ministry-for-foreign-affairs/honorary-consuls/consular-conferences/$
41Disallow: /ministries/ministry-for-foreign-affairs/honorary-consuls/consular-conferences/?
42Disallow: /page/838b7b42-f31e-4cb8-81a0-13b4fd7373a3
43Disallow: /topics/operations-and-state-assets/advisory-committee-on-anti-dumping-and-countervailing-duties$
44Disallow: /topics/operations-and-state-assets/advisory-committee-on-anti-dumping-and-countervailing-duties?
45Disallow: /topics/operations-and-state-assets/advisory-committee-on-anti-dumping-and-countervailing-duties/$
46Disallow: /topics/operations-and-state-assets/advisory-committee-on-anti-dumping-and-countervailing-duties/?
47Disallow: /page/a94a5941-a3a1-4e2e-ac24-6adf10e60a7d
48Disallow: /topics/foreign-affairs/visa-to-iceland$
49Disallow: /topics/foreign-affairs/visa-to-iceland?
50Disallow: /topics/foreign-affairs/visa-to-iceland/$
51Disallow: /topics/foreign-affairs/visa-to-iceland/?
52Disallow: /library$
53Disallow: /library?
54Disallow: /library/$
55Disallow: /library/?