DuckDuckGo / robots.txt
← back to duckduckgo.com · change detected 2mo ago (2026-08-18T23:34:24Z) · modified +5 −4
What changed
- Added Allow: /?* for *
- Removed Disallow: /2012-privacy-policy for *
- Added sitemap https://duckduckgo.com/duckduckgo-help-pages/sitemap.xml
Diff old (2026-07-13T22:52:30Z) → new (2026-08-18T23:34:24Z)
| @@ -2,8 +2,11 @@ | ||
| 2 | 2 | Disallow: /lite |
| 3 | 3 | Disallow: /html |
| 4 | 4 | |
| 5 | - # No search result pages | |
| 5 | + # Block query strings on other pages; allow them at the root (covers SERP's | |
| 6 | + # ?q= and any other root-level params). | |
| 7 | + # Google/Bing apply the least-restrictive rule on a tie, so Allow wins for root. | |
| 6 | 8 | Disallow: /*? |
| 9 | + Allow: /?* | |
| 7 | 10 | |
| 8 | 11 | # Embeddable search box (search.html, incl. ?duck=yes) — keep crawlable so its |
| 9 | 12 | # noindex meta tag is fetched and honored, dropping it from search indexes |
| @@ -18,10 +21,8 @@ | ||
| 18 | 21 | Allow: /email/privacy-guarantees |
| 19 | 22 | Allow: /email/privacy-terms |
| 20 | 23 | |
| 21 | - # Old Privacy page | |
| 22 | - Disallow: /2012-privacy-policy | |
| 23 | - | |
| 24 | 24 | User-agent: ia_archiver |
| 25 | 25 | Disallow: / |
| 26 | 26 | |
| 27 | 27 | Sitemap: https://duckduckgo.com/sitemap.xml |
| 28 | + Sitemap: https://duckduckgo.com/duckduckgo-help-pages/sitemap.xml |