Medium / robots.txt snapshot

← back to medium.com · fetched 2026-06-20T01:10:30Z (17h ago) · HTTP 200 · 884 bytes · sha256 fe87c9fc79edeba1 · raw

final URL: https://medium.com/robots.txt

1	User-Agent: *
2	Disallow: /m/
3	Disallow: /me/
4	Disallow: /@me$
5	Disallow: /@me/
6	Disallow: /*/edit$
7	Disallow: ///edit$
8	Disallow: /media/
9	Disallow: /p/*/share
10	Disallow: /r/
11	Disallow: /trending
12	Disallow: /search?q$
13	Disallow: /search?q=
14	Disallow: /*/search?q=
15	Disallow: //search/?q=
16	Disallow: //source=
17	Allow: /_/api/users/*/meta
18	Allow: /_/api/users/*/profile/stream
19	Allow: /_/api/posts/*/responses
20	Allow: /_/api/posts/*/responsesStream
21	Allow: /_/api/posts/*/related
22	User-Agent: Amazonbot
23	User-Agent: Applebot-Extended
24	User-Agent: Bytespider
25	User-Agent: ClaudeBot
26	User-Agent: FacebookBot
27	User-Agent: GoogleOther
28	User-Agent: GPTBot
29	User-Agent: meta-externalagent
30	Disallow: /
31	Allow: /about
32	Allow: /business
33	Allow: /earn
34	Allow: /gift
35	Allow: /membership
36	Allow: /partner-program
37	Allow: /verified-authors
38	Sitemap: https://medium.com/sitemap/sitemap.xml
39	License: https://medium.com/license.xml