Corriere della Sera / robots.txt
← back to corriere.it · change detected 5d ago (2026-09-14T14:12:31Z) · modified +2 −0
What changed
- Blocked user-agent ‘Baiduspider-render’ entirely
Diff old (2026-09-10T18:52:44Z) → new (2026-09-14T14:12:31Z)
| @@ -53,6 +53,8 @@ | ||
| 53 | 53 | User-agent: Stucco5000 |
| 54 | 54 | Disallow: / |
| 55 | 55 | User-agent: Baiduspider |
| 56 | + Disallow: / | |
| 57 | + User-agent: Baiduspider-render | |
| 56 | 58 | Disallow: / |
| 57 | 59 | # Fine Bot Exclusion Protocol |
| 58 | 60 |