Nextdoor / robots.txt
← back to nextdoor.com · change detected 22d ago (2026-08-27T20:19:04Z) · modified +24 −0
What changed
- Added rules for user-agent ‘bingbot’
- Added rules for user-agent ‘DuckDuckBot’
Diff old (2026-06-20T01:10:30Z) → new (2026-08-27T20:19:04Z)
| @@ -23,6 +23,30 @@ | ||
| 23 | 23 | Disallow: /rso_database_match_new/ |
| 24 | 24 | |
| 25 | 25 | User-agent: msnbot |
| 26 | + Disallow: /join/ | |
| 27 | + Disallow: /lidworden/ | |
| 28 | + Disallow: /businesses/ | |
| 29 | + Disallow: /reset_password/ | |
| 30 | + Disallow: /invitation/ | |
| 31 | + Disallow: /generic_unsub/ | |
| 32 | + Disallow: /inv_unsub/ | |
| 33 | + Disallow: /generic_nm_unsub/ | |
| 34 | + Disallow: /category_unsub/ | |
| 35 | + Disallow: /rso_database_match_new/ | |
| 36 | + | |
| 37 | + User-agent: bingbot | |
| 38 | + Disallow: /join/ | |
| 39 | + Disallow: /lidworden/ | |
| 40 | + Disallow: /businesses/ | |
| 41 | + Disallow: /reset_password/ | |
| 42 | + Disallow: /invitation/ | |
| 43 | + Disallow: /generic_unsub/ | |
| 44 | + Disallow: /inv_unsub/ | |
| 45 | + Disallow: /generic_nm_unsub/ | |
| 46 | + Disallow: /category_unsub/ | |
| 47 | + Disallow: /rso_database_match_new/ | |
| 48 | + | |
| 49 | + User-agent: DuckDuckBot | |
| 26 | 50 | Disallow: /join/ |
| 27 | 51 | Disallow: /lidworden/ |
| 28 | 52 | Disallow: /businesses/ |