NeuralCrawl

Yandex / robots.txt

← back to yandex.ru · change detected 1mo ago (2026-09-23T10:50:20Z) · modified +272 −2

What changed

Diff old (2026-09-21T16:12:30Z) → new (2026-09-23T10:50:20Z)

@@ -258,7 +258,7 @@
258258  Disallow: /support2/*zout_
259259  Disallow: /activity/
260260  Disallow: /sport
261- Disallow: /support2/sport*
261+ Disallow: /support2/sport
262262 
263263  Allow: /medicine
264264  Disallow: /medicine/search
@@ -267,7 +267,7 @@
267267  Allow: /finance/reviews
268268  Allow: /finance/banks/*/reviews
269269  Disallow: /finance/reviews*?*
270- Disallow: /finance/banks/*/reviews*?*
270+ Disallow: /finance/banks/*/reviews*?
271271 
272272  Sitemap: https://yandex.ru/support/sitemap.xml
273273  Sitemap: https://yandex.ru/blog/sitemap.xml
@@ -1081,6 +1081,276 @@
10811081  Disallow: /finance*?
10821082  Disallow: /finance/assistant
10831083 
1084+ User-agent: OAI-SearchBot
1085+ Disallow: /?
1086+ Disallow: /403.html
1087+ Disallow: /404.html
1088+ Disallow: /500.html
1089+ Disallow: /adddata
1090+ Disallow: /adresa-segmentator
1091+ Disallow: /advanced_engl.html
1092+ Disallow: /advertising
1093+ Disallow: /alice/term/
1094+ Disallow: /alice/*/term/
1095+ Disallow: /alice/old-browser
1096+ Disallow: /alice/store/orders/
1097+ Disallow: /alice/*?
1098+ Disallow: /alice/*&
1099+ Disallow: /alice/chat/
1100+ Disallow: /alice?share=
1101+ Disallow: /all-supported-params
1102+ Disallow: /articles
1103+ Disallow: /aura/
1104+ Allow: /aura/promo/
1105+ Disallow: /blog/*?text=
1106+ Disallow: /blog/*?tag=
1107+ Disallow: /blog/*/*/*
1108+ Disallow: /blog/punto
1109+ Disallow: /MAPS/
1110+ Disallow: /MaPS/
1111+ Disallow: /MapS/
1112+ Disallow: /Maps/
1113+ Disallow: /mApS/
1114+ Disallow: /harita/business/
1115+ Disallow: /maps/business/
1116+ Disallow: /maps-api/docs/js-api/reference-guide/instruction-gxs.html
1117+ Disallow: /maps-api/docs/js-api/reference-guide/instruction-rs.html
1118+ Disallow: /catalog/?text=
1119+ Disallow: /chat
1120+ Disallow: /cgi-bin/
1121+ Disallow: /cgi/
1122+ Disallow: /clck
1123+ Disallow: /collections/
1124+ Disallow: /company/*.rss
1125+ Disallow: /company/search
1126+ Disallow: /comments/*
1127+ Disallow: /courier
1128+ Disallow: /conflagexp
1129+ Disallow: /cy
1130+ Disallow: /cycounter
1131+ Disallow: /dzen
1132+ Disallow: /experiments.xml
1133+ Disallow: /formfeedback
1134+ Disallow: /fresh
1135+ Disallow: /goto_issue/
1136+ Disallow: /goto_rubric/
1137+ Disallow: /gundem
1138+ Disallow: /i/
1139+ Disallow: /images-data
1140+ Disallow: /images.html
1141+ Disallow: /images/*
1142+ Disallow: /images-apphost/*
1143+ Allow: /images/$
1144+ Allow: /images/smart/$
1145+ Allow: /images/touch/$
1146+ Allow: /images/touch/?
1147+ Allow: /images/search?text=*&source=morda*
1148+ Allow: /images/search?rpt=imageview
1149+ Allow: /images/touch/search?text=*&source=morda*
1150+ Allow: /images/touch/search?rpt=imageview
1151+ Allow: /images/pad/search?text=*&source=morda*
1152+ Allow: /images/pad/search?rpt=imageview
1153+ Disallow: /index_m
1154+ Disallow: /iznanka/
1155+ Disallow: /int_search_summary
1156+ Disallow: /delivery_tracking
1157+ Disallow: /jobs/skill-diagnostic/private/*
1158+ Disallow: /keyboard_qwerty.html
1159+ Disallow: /logotypes
1160+ Disallow: /business/widget
1161+ Disallow: /local/
1162+ Disallow: /lab/neurodetector
1163+ Disallow: /lab/habr-detector
1164+ Disallow: /more_samples
1165+ Disallow: /msearch
1166+ Disallow: /map-constructor/loader*
1167+ Disallow: /maps/print/*
1168+ Allow: /maps/*?lang=ru$
1169+ Allow: /maps/*?lang=uk$
1170+ Allow: /maps/*?lang=kk$
1171+ Allow: /maps/*?lang=uz$
1172+ Disallow: /nmaps/*?
1173+ Disallow: /mapeditor/*?
1174+ Disallow: /metro/*?from
1175+ Disallow: /masters
1176+ Disallow: /services/executor/
1177+ Disallow: /n?
1178+ Disallow: /n$
1179+ Disallow: /n/
1180+ Disallow: /neuralsearch/api
1181+ Disallow: /norobot
1182+ Disallow: /opensearch.xml
1183+ Disallow: /padsearch
1184+ Disallow: /person
1185+ Disallow: /podpiska/login.pl
1186+ Disallow: /pogoda/search
1187+ Disallow: /pogoda/404
1188+ Disallow: /pogoda/0
1189+ Disallow: /polling
1190+ Disallow: /poll/
1191+ Disallow: /portal/set/
1192+ Disallow: /portal/tune/
1193+ Disallow: /prefetch
1194+ Disallow: /promo/*goodbye*
1195+ Disallow: /promo/diskelement
1196+ Disallow: /promo/launcher/mgoodbye/*
1197+ Disallow: /promo/*welcome*
1198+ Disallow: /promo/yobject/changelog*
1199+ Disallow: /project/eda/partnership_services/$
1200+ Disallow: /q/profile/*/answers
1201+ Disallow: /q/profile/*/questions
1202+ Disallow: /q/profile/*/verifies
1203+ Disallow: /q/profile/*/articles
1204+ Disallow: /q/profile/*/subscribers
1205+ Disallow: /q/profile/*/org_answers
1206+ Disallow: /q/user/*/answers
1207+ Disallow: /q/user/*/questions
1208+ Disallow: /q/user/*/verifies
1209+ Disallow: /q/user/*/articles
1210+ Disallow: /q/user/*/subscribers
1211+ Disallow: /q/user/*/org_answers
1212+ Disallow: /soft/bm/goodbye
1213+ Disallow: /soft/chrome/ext-install/*
1214+ Disallow: /soft/chrome/searchline-install/*
1215+ Disallow: /soft/*goodbye*
1216+ Disallow: /soft/punto/mac/uninstall/*
1217+ Disallow: /soft/punto/win/uninstall/*
1218+ Disallow: /soft/*welcome*
1219+ Disallow: /soft/win/?*
1220+ Disallow: /quotes
1221+ Disallow: /realty*?*pinned_offer_id=
1222+ Disallow: /realty*?*pinned_nb_id=
1223+ Disallow: /realty/search
1224+ Disallow: /realty*?*text=
1225+ Disallow: /realty/result
1226+ Disallow: /realty/map_pins
1227+ Disallow: /realty/map_dust
1228+ Disallow: /realty/callme
1229+ Disallow: /redir
1230+ Disallow: /region_map
1231+ Disallow: /regions_list.xml
1232+ Disallow: /regions.html?
1233+ Disallow: /s/
1234+ Disallow: /save
1235+ Disallow: /safety/?
1236+ Disallow: /safety?
1237+ Disallow: /search
1238+ Allow: /search/entity/touch/
1239+ Disallow: /setup
1240+ Disallow: /showcaptcha
1241+ Disallow: /sitesearch
1242+ Disallow: /sl/*.html
1243+ Disallow: /soft/extensions/goodbye
1244+ Disallow: /sportagent
1245+ Disallow: /storeclick
1246+ Disallow: /storerequest
1247+ Disallow: /subscribe/confirm.pl
1248+ Disallow: /subscribe/view.pl
1249+ Allow: /support/
1250+ Disallow: /support/direct-images
1251+ Disallow: /support/direct-tooltips
1252+ Disallow: /support/distr
1253+ Disallow: /support/dsp
1254+ Disallow: /support/fe4be44a295cc679e19bf0b8f133083d
1255+ Disallow: /support/maps-beta
1256+ Disallow: /support/market-images
1257+ Disallow: /support/security
1258+ Disallow: /support/webmaster-images
1259+ Disallow: /support/*zout_
1260+ Disallow: /support/search-results/
1261+ Disallow: /support/praktikum/flow.html
1262+ Disallow: /support/praktikum-english/
1263+ Disallow: /telsearch
1264+ Disallow: /themes
1265+ Disallow: /toggle-experiment
1266+ Disallow: /touchsearch
1267+ Disallow: /tune*retpath=
1268+ Disallow: /turbo
1269+ Allow: /ugcpub/
1270+ Disallow: /ugcpub/cabinet
1271+ Disallow: /v$
1272+ Disallow: /viewconfig$
1273+ Disallow: /images/v$
1274+ Disallow: /images/viewconfig$
1275+ Allow: /tutor
1276+ Disallow: /tutor/admin
1277+ Disallow: /tutor/search/problems
1278+ Disallow: /versions
1279+ Disallow: /video/*
1280+ Allow: /video/$
1281+ Allow: /video/?
1282+ Allow: /video/sitemap
1283+ Allow: /video/movies/entity
1284+ Allow: /video/touch/movies/entity
1285+ Allow: /video/touch/$
1286+ Allow: /video/touch/?
1287+ Allow: /video/preview
1288+ Allow: /video/touch/preview
1289+ Allow: /video/search?text=video$
1290+ Allow: /video/touch/search?text=video$
1291+ Allow: /video/search?text=%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE$
1292+ Allow: /video/touch/search?text=%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE$
1293+ Allow: /video/video_sitemap_*.xml
1294+ Allow: /video/movies_sitemap_*.xml
1295+ Disallow: /xmlsearch
1296+ Disallow: /yandsearch
1297+ Disallow: /yca/cy
1298+ Disallow: /soft/distribution
1299+ Disallow: /soft/?*
1300+ Disallow: /promo/launcher/?*
1301+ Disallow: /opera/?*
1302+ Disallow: /firefox/?*
1303+ Disallow: /soft/bm/?*
1304+ Disallow: /soft/browsers/?*
1305+ Disallow: /soft/punto/?*
1306+ Disallow: /ie/?*
1307+ Disallow: /soft/*goodbye*
1308+ Disallow: /adult
1309+ Disallow: /addappterless
1310+ Disallow: /archive/api/image.jpg*
1311+ Allow: /archive$
1312+ Allow: /archive/project/sovsport$
1313+ Disallow: /all?
1314+ Disallow: /games/*?*reqId*
1315+ Disallow: /games/*?*pageId*
1316+ Disallow: /games/*?experimental=
1317+ Disallow: /games/*?*app-id=
1318+ Disallow: /games/*?*game-id=
1319+ Disallow: /games/*?*div-rtx-reqid=
1320+ Disallow: /games/*?*header=
1321+ Disallow: /games/*?*from=
1322+ Disallow: /games/*?*clid=
1323+ Disallow: /games/*?*deviceid=
1324+ Disallow: /games/*?*flags=
1325+ Disallow: /games/*?*inapp_id=
1326+ Disallow: /games/*?*k50id=
1327+ Disallow: /games/*?*lang=
1328+ Disallow: /games/*?*payload=
1329+ Disallow: /games/*?*pfid=
1330+ Disallow: /games/*?*promo_id=
1331+ Disallow: /games/*?*promo_intent=
1332+ Disallow: /games/*?*referrer=
1333+ Disallow: /games/*?*utm_
1334+ Disallow: /games/*?*ypr=
1335+ Disallow: /familysearch
1336+ Disallow: /schoolsearch
1337+ Disallow: /yandpage
1338+ Disallow: *maps/covid19*
1339+ Disallow: /promo/market/mobile/app*?from=
1340+ Disallow: /support2/*zout_
1341+ Disallow: /activity/
1342+ Disallow: /sport
1343+ Disallow: /support2/sport
1344+
1345+ Allow: /medicine
1346+ Disallow: /medicine/search
1347+ Disallow: /medicine?text=
1348+ Disallow: /finance
1349+ Allow: /finance/reviews
1350+ Allow: /finance/banks/*/reviews
1351+ Disallow: /finance/reviews*?*
1352+ Disallow: /finance/banks/*/reviews*?
1353+
10841354  Sitemap: https://yandex.ru/pogoda/sitemap-index.xml
10851355  Sitemap: https://yandex.ru/support/sitemap.xml
10861356  Sitemap: https://yandex.ru/blog/sitemap.xml