NeuralCrawl

🇫🇷 HAL Open Archive

hal.science · Academic & open research · rank #14 · Research repository · live robots.txt ↗ · redirect

robots.txt fetch status

The server answered but redirected /robots.txt elsewhere instead of serving a robots policy file.

Automated fetch: Redirect (2 redirects): https://www.hal.science/robots.txt → https://hal.science/robots (wrong path); received HTML

What the server returned

Preview of https://hal.science/robots (not a valid robots.txt).

Screenshot of the page served at robots.txt
I captured this screenshot and I will cache it for later visits :)
Raw HTML response (archived)

Change history

No archived robots.txt yet. The server answered but redirected /robots.txt elsewhere instead of serving a robots policy file.

Automated fetch: Redirect (2 redirects): https://www.hal.science/robots.txt → https://hal.science/robots (wrong path); received HTML