IMDb / robots.txt
← back to imdb.com · change detected 25d ago (2026-08-25T01:27:49Z) · modified +1 −0
What changed
- 🤖 AIAdded rules for AI crawler DuckAssistBot (DuckDuckGo)
Diff old (2026-07-02T00:38:22Z) → new (2026-08-25T01:27:49Z)
| @@ -22,6 +22,7 @@ | ||
| 22 | 22 | User-agent: bingbot |
| 23 | 23 | User-agent: Applebot |
| 24 | 24 | User-agent: DuckDuckBot |
| 25 | + User-agent: DuckAssistBot | |
| 25 | 26 | User-agent: Baiduspider |
| 26 | 27 | User-agent: Sogou |
| 27 | 28 | User-agent: MojeekBot |