Weather / robots.txt
← back to weather.com · change detected 8d ago (2026-07-28T22:23:38Z) · modified +1 −4
What changed
- Removed Disallow: /*?base for CriteoBot/0.1
- Removed Disallow: /*?phenomena for CriteoBot/0.1
- Removed Disallow: /*?traffic_source for CriteoBot/0.1
Diff old (2026-06-26T13:23:15Z) → new (2026-07-28T22:23:38Z)
| @@ -3,7 +3,7 @@ | ||
| 3 | 3 | # |
| 4 | 4 | |
| 5 | 5 | # |
| 6 | - # Last updated by nickhstr 03/16/2026 | |
| 6 | + # Last updated by noel.madali 07/27/2026 | |
| 7 | 7 | # |
| 8 | 8 | |
| 9 | 9 | # Explicit Allows |
| @@ -171,9 +171,6 @@ | ||
| 171 | 171 | Disallow: /?q=user/register/ |
| 172 | 172 | Disallow: /?q=user/login/ |
| 173 | 173 | Disallow: /?q=user/logout/ |
| 174 | - Disallow: /*?traffic_source | |
| 175 | - Disallow: /*?base | |
| 176 | - Disallow: /*?phenomena | |
| 177 | 174 | |
| 178 | 175 | Disallow: /sponsored |
| 179 | 176 | Disallow: /ugc |