MongoDB / robots.txt
← back to mongodb.com · change detected 29d ago (2026-07-08T20:50:19Z) · modified +2 −1
What changed
- Added Disallow: /company/blog/search for *
- Added Disallow: /docs/site-search/ for *
- Removed Disallow: /docs/search/ for *
Diff old (2026-06-20T01:10:31Z) → new (2026-07-08T20:50:19Z)
| @@ -30,6 +30,7 @@ | ||
| 30 | 30 | |
| 31 | 31 | User-agent: * |
| 32 | 32 | # Directories |
| 33 | + Disallow: /company/blog/search | |
| 33 | 34 | Disallow: /misc/ |
| 34 | 35 | Disallow: /profiles/ |
| 35 | 36 | Disallow: /u/ |
| @@ -93,7 +94,7 @@ | ||
| 93 | 94 | Disallow: /community/forums/*?api_key* |
| 94 | 95 | Disallow: /community/forums/*?*api_key* |
| 95 | 96 | Disallow: /docs/meta/ |
| 96 | - Disallow: /docs/search/ | |
| 97 | + Disallow: /docs/site-search/ | |
| 97 | 98 | Disallow: /docs/openapi/ |
| 98 | 99 | |
| 99 | 100 | # Prevent exposing future docs |