NeuralCrawl

Snapchat / robots.txt

← back to snapchat.com · change detected 17d ago (2026-07-01T12:24:12Z) · modified +3 −0

What changed

Diff old (2026-06-20T01:10:30Z)new (2026-07-01T12:24:12Z)

@@ -5,11 +5,13 @@
55  Disallow: /static/gla/
66  Disallow: /invite/
77  Disallow: /local/
8+ Disallow: /entertainment/
89 
910  # Meta-WebIndexer
1011  User-agent: Meta-WebIndexer
1112  Allow: /
1213  Disallow: /local/
14+ Disallow: /entertainment/
1315 
1416  # Meta-ExternalAgent
1517  User-agent: Meta-ExternalAgent
@@ -96,6 +98,7 @@
9698  Disallow: /getreplies
9799  Disallow: /explore/
98100  Disallow: /local/
101+ Disallow: /entertainment/
99102 
100103  # Google-Extended
101104  User-agent: Google-Extended