ChatGPT / robots.txt
← back to chatgpt.com · change detected 16d ago (2026-10-21T20:48:03Z) · modified +2 −4
What changed
- Added Allow: /unauth-mweb/assets/ for *
- Removed Allow: /football-sitemap.xml for *
- Removed Allow: /images-sitemap.xml for *
- Removed sitemap https://chatgpt.com/football-sitemap.xml
- Removed sitemap https://chatgpt.com/images-sitemap.xml
Diff old (2026-10-01T01:22:44Z) → new (2026-10-21T20:48:03Z)
| @@ -44,6 +44,8 @@ | ||
| 44 | 44 | |
| 45 | 45 | # General rules for all other bots |
| 46 | 46 | User-agent: * |
| 47 | + # Allow Googlebot to render the indexable homepage; production CSS and JavaScript live here. | |
| 48 | + Allow: /unauth-mweb/assets/ | |
| 47 | 49 | |
| 48 | 50 | # Place allows first to avoid bots skipping after Disallow: / |
| 49 | 51 | # Allow exactly the homepage |
| @@ -78,9 +80,7 @@ | ||
| 78 | 80 | Allow: /public-api/ |
| 79 | 81 | Allow: /sitemap.xml |
| 80 | 82 | Allow: /marketing-sitemap.xml |
| 81 | - Allow: /images-sitemap.xml | |
| 82 | 83 | Allow: /writing-tools-sitemap.xml |
| 83 | - Allow: /football-sitemap.xml | |
| 84 | 84 | Allow: /acquisition-landing-pages-sitemap.xml |
| 85 | 85 | Allow: /100chats |
| 86 | 86 | Allow: /api/public_content/ |
| @@ -228,7 +228,5 @@ | ||
| 228 | 228 | |
| 229 | 229 | Sitemap: https://chatgpt.com/sitemap.xml |
| 230 | 230 | Sitemap: https://chatgpt.com/marketing-sitemap.xml |
| 231 | - Sitemap: https://chatgpt.com/images-sitemap.xml | |
| 232 | 231 | Sitemap: https://chatgpt.com/writing-tools-sitemap.xml |
| 233 | - Sitemap: https://chatgpt.com/football-sitemap.xml | |
| 234 | 232 | Sitemap: https://chatgpt.com/acquisition-landing-pages-sitemap.xml |