The Guardian / robots.txt
← back to theguardian.com · change detected 1mo ago (2026-06-25T16:31:29Z) · modified +1 −0
What changed
- Blocked user-agent ‘amazon-QBusiness’ entirely
Diff old (2026-06-20T01:10:30Z) → new (2026-06-25T16:31:29Z)
| @@ -93,6 +93,7 @@ | ||
| 93 | 93 | User-agent: Buck |
| 94 | 94 | User-agent: meta-externalagent |
| 95 | 95 | User-agent: Amazonbot |
| 96 | + User-agent: amazon-QBusiness | |
| 96 | 97 | User-agent: DuckAssistBot |
| 97 | 98 | User-agent: Google-CloudVertexBot |
| 98 | 99 | User-agent: Amzn-SearchBot |