Pearson / robots.txt
← back to pearson.com · change detected 25d ago (2026-07-13T10:45:19Z) · modified +7 −0
What changed
- Added Disallow: /component-definition.json for *
- Added Disallow: /component-filters.json for *
- Added Disallow: /component-models.json for *
- Added Disallow: /content/pearson-sites/language-masters/* for *
- Added Disallow: /en-us/fragments/* for *
- Added Disallow: /en-us/platinum-test/* for *
- Added Disallow: /language-masters/* for *
Diff old (2026-06-20T01:10:31Z) → new (2026-07-13T10:45:19Z)
| @@ -132,6 +132,13 @@ | ||
| 132 | 132 | Disallow: /languages/en-tw* |
| 133 | 133 | Disallow: /languages/en-tr* |
| 134 | 134 | Disallow: /languages/en-ae* |
| 135 | + Disallow: /en-us/fragments/* | |
| 136 | + Disallow: /en-us/platinum-test/* | |
| 137 | + Disallow: /component-models.json | |
| 138 | + Disallow: /component-definition.json | |
| 139 | + Disallow: /component-filters.json | |
| 140 | + Disallow: /language-masters/* | |
| 141 | + Disallow: /content/pearson-sites/language-masters/* | |
| 135 | 142 | |
| 136 | 143 | Allow: /languages/campaigns/* |
| 137 | 144 | Allow: /languages/*/campaigns/* |