Technion / robots.txt snapshot
← back to int.technion.ac.il · fetched 2026-06-26T23:05:56Z (4h ago) · HTTP 200 · 315 bytes · sha256 1ebf3f5a5993823a · raw
final URL: https://int.technion.ac.il/robots.txt
| 1 | User-agent: * |
| 2 | Allow: / |
| 3 | Sitemap: http://int.technion.ac.il/sitemap.xml |
| 4 | Sitemap: http://int.technion.ac.il/sitemap_2.xml |
| 5 | Sitemap: http://int.technion.ac.il/sitemap_1.xml |
| 6 | Sitemap: http://int.technion.ac.il/sitemap_3.xml |
| 7 | Sitemap: http://int.technion.ac.il/sitemap_4.xml |
| 8 | Sitemap: http://int.technion.ac.il/sitemap_5.xml |