The Hill / robots.txt
← back to thehill.com · change detected 4d ago (2026-11-02T18:55:02Z) · modified +1 −2
What changed
- 🤖 AIUnblocked Google-Extended (Google)
- 🤖 AIAdded Allow: / for Google-Extended
- 🤖 AIRemoved Allow: /advertise/ for Google-Extended
Diff old (2026-08-11T21:11:35Z) → new (2026-11-02T18:55:02Z)
| @@ -41,8 +41,7 @@ | ||
| 41 | 41 | Disallow: / |
| 42 | 42 | |
| 43 | 43 | User-agent: Google-Extended |
| 44 | - Disallow: / | |
| 45 | - Allow: /advertise/ | |
| 44 | + Allow: / | |
| 46 | 45 | |
| 47 | 46 | User-agent: ClaudeBot |
| 48 | 47 | User-agent: Claude-Web |