Salesforce / robots.txt
← back to salesforce.com · change detected 2mo ago (2026-08-17T17:05:52Z) · modified +2 −1
What changed
- Added Disallow: */wp-content/uploads/sites/*/documents/ for *
- Removed Disallow: /ja-jp/wp-content/uploads/sites/13/documents/ for *
Diff old (2026-07-17T12:07:56Z) → new (2026-08-17T17:05:52Z)
| @@ -100,7 +100,8 @@ | ||
| 100 | 100 | Allow: /plus/experience/*/series/ |
| 101 | 101 | Disallow: /plus/experience/*/ |
| 102 | 102 | Disallow: /plus/experience/dreamforce_2025_x_test |
| 103 | - Disallow: /ja-jp/wp-content/uploads/sites/13/documents/ | |
| 103 | + # DPAUT-166: keep gated PDFs under /documents out of search crawlers (all locales/sites) | |
| 104 | + Disallow: */wp-content/uploads/sites/*/documents/ | |
| 104 | 105 | |
| 105 | 106 | #Disallow DAMs |
| 106 | 107 | Disallow: /content/dam/web/pt_br/www/ |