NeuralCrawl

DuckDuckGo / robots.txt

← back to duckduckgo.com · change detected 24d ago (2026-07-13T22:52:30Z) · modified +4 −0

What changed

Diff old (2026-06-20T14:56:27Z)new (2026-07-13T22:52:30Z)

@@ -4,6 +4,10 @@
44 
55  # No search result pages
66  Disallow: /*?
7+
8+ # Embeddable search box (search.html, incl. ?duck=yes) — keep crawlable so its
9+ # noindex meta tag is fetched and honored, dropping it from search indexes
10+ Allow: /search.html
711 
812  # chrome new tab page
913  Disallow: /chrome_newtab