NeuralCrawl

Perplexity / robots.txt

← back to perplexity.ai · change detected 1mo ago (2026-06-26T04:48:20Z) · modified +2 −0

What changed

Diff old (2026-06-25T22:38:12Z)new (2026-06-26T04:48:20Z)

@@ -3,6 +3,7 @@
33  Disallow: /*?*q=
44  Disallow: /search/new
55  Disallow: /search?*/
6+ Disallow: /marketing/prerelease/
67  Disallow: /onboarding/
78  Disallow: /join/
89  Disallow: /gen/
@@ -10,6 +11,7 @@
1011  Disallow: /*?*q=
1112  Disallow: /search*
1213  Disallow: /search?*/
14+ Disallow: /marketing/prerelease/
1315  Disallow: /onboarding/
1416  Disallow: /join/
1517  Disallow: /gen/