Ben-Gurion University of the Negev / robots.txt snapshot
← back to bgu.ac.il · fetched 2026-07-23T20:15:59Z (13d ago) · HTTP 200 · 181 bytes · sha256 6de25389d068a092 · raw
final URL: https://www.bgu.ac.il/robots.txt
| 1 | User-agent: * |
| 2 | Allow: / |
| 3 | |
| 4 | Disallow: *print |
| 5 | Disallow: */favorites |
| 6 | Disallow: */search-result |
| 7 | Disallow: */combinations |
| 8 | Disallow: /media/*.pdf |
| 9 | |
| 10 | Sitemap: https://www.bgu.ac.il/sitemapxml/ |