X (Twitter) / robots.txt
← back to x.com · change detected 1mo ago (2026-08-14T22:19:28Z) · modified +4 −4
What changed
- Added Disallow: /*/retweets for Bingbot
- Added Disallow: /*/retweets? for Bingbot
- Removed Disallow: /*/status/*/likes for Bingbot
- Removed Disallow: /*/status/*/retweets for Bingbot
- Added Disallow: /*/retweets for facebookexternalhit
- Added Disallow: /*/retweets? for facebookexternalhit
- Removed Disallow: /*/status/*/likes for facebookexternalhit
- Removed Disallow: /*/status/*/retweets for facebookexternalhit
- Added Disallow: /*/retweets for Googlebot
- Added Disallow: /*/retweets? for Googlebot
- Removed Disallow: /*/status/*/likes for Googlebot
- Removed Disallow: /*/status/*/retweets for Googlebot
Diff old (2026-08-13T21:57:57Z) → new (2026-08-14T22:19:28Z)
| @@ -29,10 +29,10 @@ | ||
| 29 | 29 | |
| 30 | 30 | # Only `*` and `$` are metacharacters here (RFC 9309); regex classes match |
| 31 | 31 | # literally. /photo is anchored so /status/*/photo/1 media pages stay open. |
| 32 | - Disallow: /*/status/*/likes | |
| 33 | - Disallow: /*/status/*/retweets | |
| 34 | 32 | Disallow: /*/likes |
| 35 | 33 | Disallow: /*/likes? |
| 34 | + Disallow: /*/retweets | |
| 35 | + Disallow: /*/retweets? | |
| 36 | 36 | Disallow: /*/media |
| 37 | 37 | Disallow: /*/media? |
| 38 | 38 | Disallow: /*/photo$ |
| @@ -62,10 +62,10 @@ | ||
| 62 | 62 | Disallow: /account/deactivated |
| 63 | 63 | Disallow: /settings/deactivated |
| 64 | 64 | |
| 65 | - Disallow: /*/status/*/likes | |
| 66 | - Disallow: /*/status/*/retweets | |
| 67 | 65 | Disallow: /*/likes |
| 68 | 66 | Disallow: /*/likes? |
| 67 | + Disallow: /*/retweets | |
| 68 | + Disallow: /*/retweets? | |
| 69 | 69 | Disallow: /*/media |
| 70 | 70 | Disallow: /*/media? |
| 71 | 71 | Disallow: /*/photo$ |