Ben-Gurion University of the Negev / robots.txt
← back to bgu.ac.il · change detected 13d ago (2026-07-23T20:15:59Z) · modified +1 −0
What changed
- Added Disallow: /media/*.pdf for *
Diff old (2026-06-26T23:05:56Z) → new (2026-07-23T20:15:59Z)
| @@ -5,5 +5,6 @@ | ||
| 5 | 5 | Disallow: */favorites |
| 6 | 6 | Disallow: */search-result |
| 7 | 7 | Disallow: */combinations |
| 8 | + Disallow: /media/*.pdf | |
| 8 | 9 | |
| 9 | 10 | Sitemap: https://www.bgu.ac.il/sitemapxml/ |