NeuralCrawl

Khan Academy / robots.txt snapshot

← back to khanacademy.org · fetched 2026-06-20T01:10:31Z (18h ago) · HTTP 200 · 1129 bytes · sha256 de8d690cc29d476a · raw

final URL: https://www.khanacademy.org/robots.txt

1User-agent: GPTBot
2Disallow: /
3
4User-agent: *
5Sitemap: https://www.khanacademy.org/sitemap.xml
6Disallow: /_ah/
7Disallow: /admin/
8Disallow: /api/internal/_bb/
9Disallow: /crash
10Disallow: /devadmin/
11Disallow: /embed_video
12Disallow: /login?continue=*
13Disallow: /postlogin
14Disallow: /preview/
15Disallow: /search
16Disallow: /searchtest
17Disallow: /settings/linkaccount
18Disallow: /khan-labs?step=terms-and-conditions
19Disallow: /khan-labs?step=terms-and-conditions-redirect
20Disallow: /khan-labs?step=no-birthdate
21Disallow: /khan-labs?step=under-age-gate
22Disallow: /khan-labs?step=english-only
23Disallow: /khan-labs?step=us-only
24Disallow: /khan-labs?step=children-over-limit
25Disallow: /khan-labs?step=ineligible
26Disallow: /khanmigo/checkout?step=terms-and-conditions
27Disallow: /khanmigo/checkout?step=terms-and-conditions-redirect
28Disallow: /khanmigo/checkout?step=no-birthdate
29Disallow: /khanmigo/checkout?step=under-age-gate
30Disallow: /khanmigo/checkout?step=english-only
31Disallow: /khanmigo/checkout?step=us-only
32Disallow: /khanmigo/checkout?step=children-over-limit
33Disallow: /khanmigo/checkout?step=ineligible
34Disallow: *?qa_expand_key*