Salesforce / robots.txt
← back to salesforce.com · change detected 20d ago (2026-07-17T12:07:56Z) · modified +2 −0
What changed
- Added Disallow: /*/wp-content/uploads/sites/*/documents/legal/no-index/*.pdf$ for AdsBot-Google
- Added Disallow: /*/wp-content/uploads/sites/*/partners/*.pdf$ for AdsBot-Google
Diff old (2026-07-02T12:51:16Z) → new (2026-07-17T12:07:56Z)
| @@ -254,6 +254,8 @@ | ||
| 254 | 254 | Disallow: /dig-perf-test/ |
| 255 | 255 | Disallow: /content/dam/web/en_us/www/documents/legal/no-index/ |
| 256 | 256 | Disallow: /content/dam/web/en_us/www/documents/legal/work-unit-catalog/ |
| 257 | + Disallow: /*/wp-content/uploads/sites/*/documents/legal/no-index/*.pdf$ | |
| 258 | + Disallow: /*/wp-content/uploads/sites/*/partners/*.pdf$ | |
| 257 | 259 | |
| 258 | 260 | # STARTS |
| 259 | 261 | # Block crawl of ._filter.alphaSort which is duplicate of /customer-success-stories/ |