NeuralCrawl

Weather / robots.txt

← back to weather.com · change detected 24d ago (2026-10-14T18:09:36Z) · modified +10 −1

What changed

Diff old (2026-10-06T21:31:08Z) → new (2026-10-14T18:09:36Z)

@@ -3,7 +3,7 @@
33  #
44 
55  #
6- # Last updated by nick.hester 10/02/2026
6+ # Last updated by nick.hester 10/06/2026
77  #
88 
99  #
@@ -98,6 +98,15 @@
9898  Disallow: /pocasi/
9999  Disallow: /cuaca/
100100  Disallow: /weer/
101+ # Duplicate forecast URLs that canonicalize to the param-less page (CW-12397)
102+ Disallow: /*/hourbyhour/day-
103+ Disallow: /*?t=
104+ Disallow: /*&t=
105+ Disallow: /*?metric=
106+ Disallow: /*&metric=
107+ # Scoped to /localalerts so legacy /l/{id}?phenomena= 301s stay crawlable (CW-10292)
108+ Disallow: /*/localalerts?phenomena=
109+ Disallow: /*/localalerts?*&phenomena=
101110 
102111  #
103112  # Block Bots