# https://www.robotstxt.org/robotstxt.html User-agent: * Disallow: /*?*q= Disallow: /search/new Disallow: /search?*/ Disallow: /onboarding/ Disallow: /join/ Disallow: /gen/ User-agent: Googlebot Disallow: /*?*q= Disallow: /search* Disallow: /search?*/ Disallow: /onboarding/ Disallow: /join/ Disallow: /gen/ Sitemap: https://www.perplexity.ai/sitemap.xml Sitemap: https://www.perplexity.ai/help-center/sitemap.xml