NeuralCrawl

De Telegraaf / robots.txt

← back to telegraaf.nl · change detected 11d ago (2026-09-07T17:46:37Z) · modified +3 −3

What changed

Diff old (2026-08-10T14:47:29Z)new (2026-09-07T17:46:37Z)

@@ -1,4 +1,4 @@
1- # Generated: 2026-08-10T08:26:49.822Z
1+ # Generated: 2026-09-07T12:28:13.659Z
22  # Brand: telegraaf.nl | Environment: prod
33 
44  # All copyrights, neighbouring rights and database rights in the content and layout of this website/app are explicitly reserved and are for personal, non-commercial use only.
@@ -138,8 +138,8 @@
138138  User-agent: xAI-Grok
139139  Disallow: /
140140 
141- # User-agent: Bingbot
142- # Disallow: /
141+ User-agent: Bingbot
142+ Disallow: /
143143 
144144  #list sitemaps
145145  Sitemap: https://www.telegraaf.nl/sitemap.xml