Nanyang Technological University / robots.txt snapshot
← back to ntu.edu.sg · fetched 2026-06-26T14:15:22Z (4h ago) · HTTP 200 · 118 bytes · sha256 98d9e1d179210c19 · raw
final URL: https://www.ntu.edu.sg/robots.txt
| 1 | # www.robotstxt.org/ |
| 2 | |
| 3 | # Allow crawling of all content |
| 4 | User-agent: * |
| 5 | Disallow: /CustomWebForms |
| 6 | Disallow: /Sitefinity/* |