Adidas / robots.txt
← back to adidas.com · change detected 1mo ago (2026-06-29T11:44:49Z) · modified +5 −1
What changed
- 🤖 AIAdded rules for AI crawler ClaudeBot (Anthropic)
Diff old (2026-06-28T17:41:09Z) → new (2026-06-29T11:44:49Z)
| @@ -1,4 +1,4 @@ | ||
| 1 | - # Sun, 28 Jun 2026 11:41:16 GMT (build: jaas-569) | |
| 1 | + # Mon, 29 Jun 2026 11:35:01 GMT (build: jaas-570) | |
| 2 | 2 | # US |
| 3 | 3 | |
| 4 | 4 | User-agent: * |
| @@ -194,6 +194,9 @@ | ||
| 194 | 194 | User-Agent: Pinterestbot |
| 195 | 195 | Crawl-delay: 10 |
| 196 | 196 | |
| 197 | + User-Agent: ClaudeBot | |
| 198 | + Crawl-delay: 6 | |
| 199 | + | |
| 197 | 200 | Sitemap: https://www.adidas.com/bh/ar/sitemap |
| 198 | 201 | Sitemap: https://www.adidas.com/bh/en/sitemap |
| 199 | 202 | Sitemap: https://www.adidas.com/kw/ar/sitemap |
| @@ -202,4 +205,5 @@ | ||
| 202 | 205 | Sitemap: https://www.adidas.com/om/en/sitemap |
| 203 | 206 | Sitemap: https://www.adidas.com/qa/ar/sitemap |
| 204 | 207 | Sitemap: https://www.adidas.com/qa/en/sitemap |
| 208 | + | |
| 205 | 209 | Sitemap: https://www.adidas.com/glass/sitemaps/adidas/US/en/sitemap-index.xml |