NeuralCrawl

Coursera / robots.txt snapshot

← back to coursera.org · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 1254 bytes · sha256 c3a7078ab8dbcea4 · raw

final URL: https://www.coursera.org/robots.txt

1User-agent: *
2Allow: /api/utilities/v1/imageproxy
3Disallow: /maestro/api/
4Disallow: /api/
5Disallow: /maestro/
6Disallow: /ui/
7Disallow: /signature/voucher/
8Disallow: /account/
9Disallow: /acclaimbadge/
10Disallow: /voucher/
11Disallow: /search
12Disallow: /ent-website/
13Disallow: /learn-perf/
14Disallow: /specializations-perf/
15Disallow: /professional-certificates-perf/
16Disallow: /learn-noperf/
17Disallow: /specializations-noperf/
18Disallow: /professional-certificates-noperf/
19Disallow: /business/xmlrpc.php
20Disallow: /business/wp-content/uploads/
21Disallow: /business/search
22Disallow: /business/teams/search
23Disallow: /organizations/
24Sitemap: https://www.coursera.org/sitemap.xml
25
26
27
28User-agent: CCBot
29Disallow: /lecture/
30
31User-agent: GPTBot
32Disallow: /lecture/
33
34User-agent: ClaudeBot
35Disallow: /lecture/
36
37User-agent: MistralAI-User
38Disallow: /lecture/
39
40User-agent: Google-Extended
41Disallow: /lecture/
42
43User-agent: PerplexityBot
44Disallow: /lecture/
45
46User-agent: LinkedInBot
47Allow: /account/accomplishments/
48
49User-agent: Twitterbot
50Allow: /account/accomplishments/
51
52User-agent: meta-externalagent
53Disallow: /
54
55User-agent: OAI-SearchBot
56Allow: /api/utilities/v1/imageproxy
57Disallow: /api/
58
59User-agent: ChatGPT-User
60Allow: /api/utilities/v1/imageproxy
61Disallow: /api/