NeuralCrawl

University of Edinburgh / robots.txt

← back to ed.ac.uk · change detected 2d ago (2026-11-05T13:47:51Z) · modified +0 −1

What changed

Diff old (2026-06-26T14:15:22Z) → new (2026-11-05T13:47:51Z)

@@ -46,7 +46,6 @@
4646  Disallow: /modules/README.txt
4747  Disallow: /sites/README.txt
4848  Disallow: /themes/README.txt
49- Disallow: /web.config
5049  # Paths (clean URLs)
5150  Disallow: /admin/
5251  Disallow: /comment/reply/