AliExpress / robots.txt
← back to aliexpress.com · change detected 9d ago (2026-07-28T03:59:04Z) · modified +0 −7
What changed
- Removed all rules for user-agent ‘AdsBot-Google’
- Removed all rules for user-agent ‘AdsBot-Google-Mobile’
- Removed Disallow: /wholesale* for *
Diff old (2026-06-21T13:32:37Z) → new (2026-07-28T03:59:04Z)
| @@ -1,11 +1,5 @@ | ||
| 1 | 1 | User-agent: Googlebot |
| 2 | 2 | Disallow: */aeglodetailweb/api/msite/item?productId* |
| 3 | - | |
| 4 | - User-agent: AdsBot-Google | |
| 5 | - Disallow: /i/* | |
| 6 | - | |
| 7 | - User-agent: AdsBot-Google-Mobile | |
| 8 | - Disallow: /i/* | |
| 9 | 3 | |
| 10 | 4 | User-agent: * |
| 11 | 5 | Disallow: /items/* |
| @@ -13,7 +7,6 @@ | ||
| 13 | 7 | Disallow: /search/* |
| 14 | 8 | Allow: /wholesale.html$ |
| 15 | 9 | Allow: /wholesale-page-*.html |
| 16 | - Disallow: /wholesale* | |
| 17 | 10 | Disallow: /productdetail/* |
| 18 | 11 | Allow: /api/data_homepage.do |
| 19 | 12 | Disallow: /api/* |