NeuralCrawl

The Times of India / robots.txt

← back to timesofindia.indiatimes.com · change detected 15d ago (2026-07-20T13:08:59Z) · modified +2 −0

What changed

Diff old (2026-06-20T01:10:30Z)new (2026-07-20T13:08:59Z)

@@ -170,6 +170,7 @@
170170  Disallow: /ext_*
171171  Disallow: /*_rsc=
172172  Disallow: /meta.json
173+ Disallow: */lottery/*
173174 
174175  User-agent: Googlebot-News
175176  Allow: /
@@ -339,6 +340,7 @@
339340  Disallow: /ext_*
340341  Disallow: /*_rsc=
341342  Disallow: /meta.json
343+ Disallow: */lottery/*
342344 
343345  User-agent: AdsBot-Google
344346  Allow: /trivia/