NeuralCrawl

IMDb / robots.txt

← back to imdb.com · change detected 2mo ago (2026-08-31T21:34:42Z) · modified +0 −8

What changed

Diff old (2026-08-28T02:24:20Z) → new (2026-08-31T21:34:42Z)

@@ -64,14 +64,6 @@
6464 
6565  User-agent: AmazonAdBot
6666  Allow: /
67- Disallow: /find
68- Disallow: /*/find
69- Disallow: /find/
70- Disallow: /*/find/
71- Disallow: /search/title/*
72- Disallow: /*/search/title/*
73- Disallow: /search/name/*
74- Disallow: /*/search/name/*
7567 
7668  User-agent: *
7769  Disallow: /