Vistra / robots.txt
← back to vistra.com · change detected 22d ago (2026-08-27T20:19:04Z) · modified +4 −0
What changed
- Added Disallow: /*/media/oembed for *
- Added Disallow: /media/oembed for *
- Added Disallow: /*/media/oembed for Googlebot-News
- Added Disallow: /media/oembed for Googlebot-News
Diff old (2026-06-20T01:10:30Z) → new (2026-08-27T20:19:04Z)
| @@ -30,6 +30,8 @@ | ||
| 30 | 30 | Disallow: /*/comment/reply/ |
| 31 | 31 | Disallow: /filter/tips |
| 32 | 32 | Disallow: /*/filter/tips |
| 33 | + Disallow: /media/oembed #media embed endpoints, not pages | |
| 34 | + Disallow: /*/media/oembed | |
| 33 | 35 | Disallow: /node/ #PP changed from /node/add/ |
| 34 | 36 | Disallow: /*/node/ |
| 35 | 37 | Disallow: /search/? #PP added "?" |
| @@ -77,6 +79,8 @@ | ||
| 77 | 79 | Disallow: /*/comment/reply/ |
| 78 | 80 | Disallow: /filter/tips |
| 79 | 81 | Disallow: /*/filter/tips |
| 82 | + Disallow: /media/oembed #media embed endpoints, not pages | |
| 83 | + Disallow: /*/media/oembed | |
| 80 | 84 | Disallow: /node/ #PP changed from /node/add/ |
| 81 | 85 | Disallow: /*/node/ |
| 82 | 86 | Disallow: /search/? #PP added "?" |