Mail / robots.txt snapshot

← back to mail.ru · fetched 2026-06-26T13:23:15Z (3h ago) · HTTP 200 · 433 bytes · sha256 d3fd6768e203ab40 · raw

final URL: https://mail.ru/robots.txt

1	User-agent: *
2	Allow: /*.css
3	Allow: /*.jpg
4	Allow: /*.gif
5	Allow: /*.png
6	Allow: /v/j/*.js
7	Allow: /$
8	Disallow: /
9
10	User-agent: Googlebot
11	Allow: /*.css
12	Allow: /*.jpg
13	Allow: /*.gif
14	Allow: /*.png
15	Allow: /v/j/*.js
16	Disallow: *?
17	Disallow: *search
18	Disallow: *auth
19	Disallow: *api
20
21	User-agent: Yandex
22	Allow: /*.css
23	Allow: /*.jpg
24	Allow: /*.gif
25	Allow: /*.png
26	Allow: /v/j/*.js
27	Allow: /$
28	Disallow: /
29
30	User-agent: Twitterbot
31	Disallow: /
32	Allow: /?logo=