PanguBot
Huawei · LLM training crawler
29 of 1203 monitored sites (2.4%) block PanguBot by name.
PanguBot blocking over time share of monitored sites · weekly snapshot
Sites blocking
PanguBot
2026-06-20
2026-11-07
5 earlier weeks omitted (archive building) · 21 weekly snapshots with reliable coverage
Recent PanguBot events
- 2026-10-27 — Mastodon: Blocked PanguBot (Huawei) entirely diff
- 2026-10-20 — Daily Mail: Added Allow: /llms.txt for PanguBot diff
- 2026-09-23 — Daily Mail: Removed Allow: /buyline/ for PanguBot diff
- 2026-08-12 — Nvidia: Removed rules for AI crawler PanguBot (Huawei) diff
- 2026-08-11 — Der Spiegel: Blocked PanguBot (Huawei) entirely diff
- 2026-06-30 — Indeed: Added rules for AI crawler PanguBot (Huawei) diff
Sites blocking PanguBot
| Site | Sector | Badge |
|---|---|---|
| Amazon | Retailing |  |
| Ars Technica | Technology |  |
| Behance | Graphics Multimedia and Web Design |  |
| Bild | News |  |
| CNN | Broadcast News |  |
| Corriere della Sera | News |  |
| Daily Mail | News |  |
| Der Spiegel | News |  |
| Die Zeit | News |  |
| IGN | Web |  |
| Le Monde | News |  |
| Letterboxd | Arts and Entertainment |  |
| Mastodon | Social Network (Fediverse) |  |
| Msn | Web |  |
| Nintendo | Video Games |  |
| Parker Hannifin | Industrials |  |
| Politico | News |  |
| Sky News | Broadcast News |  |
| Slate | Digital Media |  |
| Snapchat | Messaging |  |
| Storyblocks | Stock media |  |
| The Globe and Mail | News |  |
| The New Yorker | Magazine |  |
| The Telegraph | News |  |
| Toronto Star | News |  |
| Tripadvisor | Web |  |
| Uol | Web |  |
| USA Today | News |  |
| Wired | Technology |  |