Le Figaro / robots.txt
← back to lefigaro.fr · change detected 8d ago (2026-07-27T15:48:23Z) · modified +0 −3
What changed
- 🤖 AIUnblocked Bytespider (ByteDance) - rules removed
Diff old (2026-07-20T19:11:56Z) → new (2026-07-27T15:48:23Z)
| @@ -128,9 +128,6 @@ | ||
| 128 | 128 | Disallow: / |
| 129 | 129 | |
| 130 | 130 | User-agent: anthropic-ai |
| 131 | - Disallow: / | |
| 132 | - | |
| 133 | - User-agent: Bytespider | |
| 134 | 131 | Disallow: / |
| 135 | 132 | |
| 136 | 133 | User-agent: CCBot |