Perplexity / robots.txt snapshot

← back to perplexity.ai · fetched 2026-06-20T01:10:30Z (15h ago) · HTTP 200 · 1218 bytes · sha256 6fe555549ff618f5 · raw

final URL: https://www.perplexity.ai/robots.txt

1	# https://www.robotstxt.org/robotstxt.html
2	User-agent: *
3	Disallow: /?q=
4	Disallow: /search/new
5	Disallow: /search?*/
6	Disallow: /socket.io/
7	Disallow: /onboarding/
8	Disallow: /join/
9	Allow: /academic
10	Allow: /api-platform
11	Allow: /assistant
12	Allow: /comet
13	Allow: /comet/gettingstarted
14	Allow: /comet/resources
15	Allow: /enterprise
16	Allow: /finance
17	Allow: /hub
18	Allow: /hub/careers
19	Allow: /hub/careers/interview-guide
20	Allow: /hub/deep-research
21	Allow: /hub/products/app-connectors/snowflake
22	Allow: /hub/products/computer-for-windows
23	Allow: /hub/products/integrations/microsoft
24	Allow: /pro
25	User-agent: Googlebot
26	Disallow: /?q=
27	Disallow: /search*
28	Disallow: /search?*/
29	Disallow: /socket.io/
30	Disallow: /onboarding/
31	Disallow: /join/
32	Allow: /academic
33	Allow: /api-platform
34	Allow: /assistant
35	Allow: /comet
36	Allow: /comet/gettingstarted
37	Allow: /comet/resources
38	Allow: /enterprise
39	Allow: /finance
40	Allow: /hub
41	Allow: /hub/careers
42	Allow: /hub/careers/interview-guide
43	Allow: /hub/deep-research
44	Allow: /hub/products/app-connectors/snowflake
45	Allow: /hub/products/computer-for-windows
46	Allow: /hub/products/integrations/microsoft
47	Allow: /pro
48	Sitemap: https://www.perplexity.ai/sitemap.xml
49	Sitemap: https://www.perplexity.ai/help-center/sitemap.xml