Arrow Electronics / robots.txt
← back to arrow.com · change detected 10d ago (2026-10-27T16:50:31Z) · modified +1 −3
What changed
- 🤖 AIUnblocked GPTBot (OpenAI)
- 🤖 AIAdded Allow: / for GPTBot
- 🤖 AIRemoved Allow: /ais/* for GPTBot
- 🤖 AIRemoved Allow: /globalecs/* for GPTBot
Diff old (2026-10-13T05:44:23Z) → new (2026-10-27T16:50:31Z)
| @@ -49,9 +49,7 @@ | ||
| 49 | 49 | Allow: /globalecs/* |
| 50 | 50 | |
| 51 | 51 | User-agent: GPTBot |
| 52 | - Disallow: / | |
| 53 | - Allow: /ais/* | |
| 54 | - Allow: /globalecs/* | |
| 52 | + Allow: / | |
| 55 | 53 | |
| 56 | 54 | User-agent: ChatGPT-User |
| 57 | 55 | Disallow: / |