KTH Royal Institute of Technology / robots.txt snapshot

← back to kth.se · fetched 2026-06-26T14:15:22Z (4h ago) · HTTP 200 · 941 bytes · sha256 ba3d31bfc57b3ed2 · raw

final URL: https://www.kth.se/robots.txt

1	#
2	# well-known resource robots.txt from 17.392
3	#
4	User-agent: *
5	Disallow: /lediga-jobb/language_redirect/
6	Disallow: /lediga-jobb/interna/
7	Disallow: /form/
8	Disallow: /public/
9	Disallow: /cm/
10	Disallow: /info/
11	Disallow: /work/
12	Disallow: /xyz/
13	Disallow: /xyz
14	Disallow: /en/xyz/
15	Disallow: /en/xyz
16	Disallow: /2.994/
17	Disallow: /2.9631/
18	Disallow: /2.1019/
19	Disallow: /2.1166/
20	Disallow: /2.1218/
21	Disallow: /2.1219/
22	Disallow: /2.36446/
23	Disallow: /2.14566/
24	Disallow: /2.28744/
25	Disallow: /2.98714/
26	Disallow: /en/2.28744/
27	Disallow: /2.9631/
28	Disallow: /en/2.9631/
29	Disallow: /search
30	Disallow: /social/user/_report_/abuse/
31	Disallow: /gemensamt/kategorier-1.31190
32	Disallow: /en/gemensamt/kategorier-1.31190
33	Disallow: /social/api/profile/1.1/
34	Disallow: /test/
35	Disallow: /blogs/tags
36	Disallow: /es/
37	Disallow: /?rss=
38	Disallow: /?iCal=
39	Disallow: /api/icalendar/
40	Disallow: /start/
41	Disallow: /intranat
42	Disallow: /sci/2.840
43
44	Sitemap: https://www.kth.se/sitemap.xml