Substack / robots.txt snapshot

← back to substack.com · fetched 2026-07-06T20:20:23Z (1mo ago) · HTTP 200 · 585 bytes · sha256 e468186aecca9269 · raw

final URL: https://substack.com/robots.txt

1	User-agent: BLEXBot
2	Disallow: /
3
4	User-agent: Twitterbot
5	Disallow:
6
7
8
9	User-agent: *
10	Disallow: /action/
11	Disallow: /publish
12	Disallow: /sign-in
13	Disallow: /channel-frame
14	Disallow: /session-attribution-frame
15	Disallow: /visited-surface-frame
16	Disallow: /feed/private
17	Disallow: /feed/podcast//private/.rss
18	Disallow: /subscribe
19	Disallow: /lovestack/*
20	Disallow: /p//comment/
21	Disallow: /inbox/post/*
22	Disallow: /notes/post/*
23	Disallow: /embed
24
25	User-agent: facebookexternalhit
26	Allow: /
27	Allow: /subscribe
28
29
30	SITEMAP: https://substack.com/sitemap.xml
31	SITEMAP: https://substack.com/news_sitemap.xml
32