Le Figaro / robots.txt
← back to lefigaro.fr · change detected 1mo ago (2026-09-09T06:19:28Z) · modified +3 −0
What changed
- Blocked user-agent ‘ExaSearchBot’ entirely
Diff old (2026-08-25T07:34:33Z) → new (2026-09-09T06:19:28Z)
| @@ -259,6 +259,9 @@ | ||
| 259 | 259 | Disallow: / |
| 260 | 260 | |
| 261 | 261 | User-agent: ExaBot |
| 262 | + Disallow: / | |
| 263 | + | |
| 264 | + User-agent: ExaSearchBot | |
| 262 | 265 | Disallow: / |
| 263 | 266 | |
| 264 | 267 | User-agent: Explore |