University of Haifa / robots.txt snapshot
← back to haifa.ac.il · fetched 2026-06-26T23:05:56Z (4h ago) · HTTP 200 · 227 bytes · sha256 59aaab2e7ed9a85b · raw
final URL: https://www.haifa.ac.il/robots.txt
| 1 | User-agent: * |
| 2 | |
| 3 | Disallow: /wp-admin/ |
| 4 | |
| 5 | Allow: /wp-admin/admin-ajax.php |
| 6 | |
| 7 | Disallow: *?s= |
| 8 | |
| 9 | Disallow: /search/ |
| 10 | |
| 11 | Disallow: *?csrt= |
| 12 | |
| 13 | Disallow: *?undefined=undefined |
| 14 | |
| 15 | Disallow: /feed/ |
| 16 | |
| 17 | Sitemap: https://www.haifa.ac.il/sitemap_index.xml |