Yandex / robots.txt
← back to yandex.ru · change detected 1mo ago (2026-09-21T16:12:30Z) · modified +0 −190
What changed
- Removed Allow: /blogs$ for *
- Removed Allow: /blogs/$ for *
- Removed Allow: /blogs/pad$ for *
- Removed Allow: /blogs/pad/$ for *
- Removed Allow: /people/$ for *
- Removed Allow: /people/pad$ for *
- Removed Allow: /people/pad/$ for *
- Removed Allow: /talk for *
- Removed Allow: /talk/user for *
- Removed Allow: /uslugi/* for *
- Removed Allow: /yaca/$ for *
- Removed Allow: /yaca/*.xml$ for *
- Removed Allow: /yaca/cat/*/$ for *
- Removed Allow: /yaca/m/$ for *
- Removed Allow: /yaca/m/yca/cat/*/$ for *
- Removed Disallow: /about.html for *
- Removed Disallow: /autopoet for *
- Removed Disallow: /blogs* for *
- Removed Disallow: /bus/api/* for *
- Removed Disallow: /bus/orders* for *
- Removed Disallow: /chisla.html for *
- Removed Disallow: /efir for *
- Removed Disallow: /element/*goodbye* for *
- Removed Disallow: /element/?* for *
- Removed Disallow: /infected for *
- Removed Disallow: /mirror*?*ajax=1* for *
- Removed Disallow: /mirror*?*parent-reqid* for *
- Removed Disallow: /mirror/hide for *
- Removed Disallow: /patents/ for *
- Removed Disallow: /people/* for *
- Removed Disallow: /rubric2sport for *
- Removed Disallow: /skazki for *
- Removed Disallow: /sport*?*ajax=1* for *
- Removed Disallow: /sport*?*parent-reqid* for *
- Removed Disallow: /talk/api for *
- Removed Disallow: /talk/create for *
- Removed Disallow: /talk/user/*/article for *
- Removed Disallow: /uslugi/*/category/doctors/ for *
- Removed Disallow: /uslugi/cab for *
- Removed Disallow: /yaca for *
- Removed Disallow: /yaca/*/geo/ for *
- Removed Disallow: /yaca/*/synt2/ for *
- Removed Disallow: /yaca/*/time/ for *
- Removed Disallow: /yaca/*/tungrp/ for *
- Removed Disallow: /yaca/cat/*/geo/* for *
- Removed Disallow: /yaca/result.xml for *
- Removed Allow: /blogs$ for Bingbot
- Removed Allow: /blogs/$ for Bingbot
- Removed Allow: /blogs/pad$ for Bingbot
- Removed Allow: /blogs/pad/$ for Bingbot
- ... and 132 more change(s)
Diff old (2026-09-14T14:12:31Z) → new (2026-09-21T16:12:30Z)
| @@ -4,7 +4,6 @@ | ||
| 4 | 4 | Disallow: /403.html |
| 5 | 5 | Disallow: /404.html |
| 6 | 6 | Disallow: /500.html |
| 7 | - Disallow: /about.html | |
| 8 | 7 | Disallow: /adddata |
| 9 | 8 | Disallow: /adresa-segmentator |
| 10 | 9 | Disallow: /advanced_engl.html |
| @@ -21,18 +20,10 @@ | ||
| 21 | 20 | Disallow: /articles |
| 22 | 21 | Disallow: /aura/ |
| 23 | 22 | Allow: /aura/promo/ |
| 24 | - Disallow: /autopoet | |
| 25 | 23 | Disallow: /blog/*?text= |
| 26 | 24 | Disallow: /blog/*?tag= |
| 27 | 25 | Disallow: /blog/*/*/* |
| 28 | 26 | Disallow: /blog/punto |
| 29 | - Disallow: /blogs* | |
| 30 | - Allow: /blogs$ | |
| 31 | - Allow: /blogs/$ | |
| 32 | - Allow: /blogs/pad/$ | |
| 33 | - Allow: /blogs/pad$ | |
| 34 | - Disallow: /bus/orders* | |
| 35 | - Disallow: /bus/api/* | |
| 36 | 27 | Disallow: /MAPS/ |
| 37 | 28 | Disallow: /MaPS/ |
| 38 | 29 | Disallow: /MapS/ |
| @@ -46,7 +37,6 @@ | ||
| 46 | 37 | Disallow: /chat |
| 47 | 38 | Disallow: /cgi-bin/ |
| 48 | 39 | Disallow: /cgi/ |
| 49 | - Disallow: /chisla.html | |
| 50 | 40 | Disallow: /clck |
| 51 | 41 | Disallow: /collections/ |
| 52 | 42 | Disallow: /company/*.rss |
| @@ -58,7 +48,6 @@ | ||
| 58 | 48 | Disallow: /cycounter |
| 59 | 49 | Disallow: /dzen |
| 60 | 50 | Disallow: /experiments.xml |
| 61 | - Disallow: /efir | |
| 62 | 51 | Disallow: /formfeedback |
| 63 | 52 | Disallow: /fresh |
| 64 | 53 | Disallow: /goto_issue/ |
| @@ -80,7 +69,6 @@ | ||
| 80 | 69 | Allow: /images/pad/search?text=*&source=morda* |
| 81 | 70 | Allow: /images/pad/search?rpt=imageview |
| 82 | 71 | Disallow: /index_m |
| 83 | - Disallow: /infected | |
| 84 | 72 | Disallow: /iznanka/ |
| 85 | 73 | Disallow: /int_search_summary |
| 86 | 74 | Disallow: /delivery_tracking |
| @@ -111,11 +99,6 @@ | ||
| 111 | 99 | Disallow: /norobot |
| 112 | 100 | Disallow: /opensearch.xml |
| 113 | 101 | Disallow: /padsearch |
| 114 | - Disallow: /patents/ | |
| 115 | - Disallow: /people/* | |
| 116 | - Allow: /people/$ | |
| 117 | - Allow: /people/pad/$ | |
| 118 | - Allow: /people/pad$ | |
| 119 | 102 | Disallow: /person |
| 120 | 103 | Disallow: /podpiska/login.pl |
| 121 | 104 | Disallow: /pogoda/search |
| @@ -165,7 +148,6 @@ | ||
| 165 | 148 | Disallow: /region_map |
| 166 | 149 | Disallow: /regions_list.xml |
| 167 | 150 | Disallow: /regions.html? |
| 168 | - Disallow: /rubric2sport | |
| 169 | 151 | Disallow: /s/ |
| 170 | 152 | Disallow: /save |
| 171 | 153 | Disallow: /safety/? |
| @@ -175,7 +157,6 @@ | ||
| 175 | 157 | Disallow: /setup |
| 176 | 158 | Disallow: /showcaptcha |
| 177 | 159 | Disallow: /sitesearch |
| 178 | - Disallow: /skazki | |
| 179 | 160 | Disallow: /sl/*.html |
| 180 | 161 | Disallow: /soft/extensions/goodbye |
| 181 | 162 | Disallow: /sportagent |
| @@ -197,11 +178,6 @@ | ||
| 197 | 178 | Disallow: /support/search-results/ |
| 198 | 179 | Disallow: /support/praktikum/flow.html |
| 199 | 180 | Disallow: /support/praktikum-english/ |
| 200 | - Disallow: /talk/create | |
| 201 | - Disallow: /talk/api | |
| 202 | - Disallow: /talk/user/*/article | |
| 203 | - Allow: /talk | |
| 204 | - Allow: /talk/user | |
| 205 | 181 | Disallow: /telsearch |
| 206 | 182 | Disallow: /themes |
| 207 | 183 | Disallow: /toggle-experiment |
| @@ -214,9 +190,6 @@ | ||
| 214 | 190 | Disallow: /viewconfig$ |
| 215 | 191 | Disallow: /images/v$ |
| 216 | 192 | Disallow: /images/viewconfig$ |
| 217 | - Allow: /uslugi/* | |
| 218 | - Disallow: /uslugi/cab | |
| 219 | - Disallow: /uslugi/*/category/doctors/ | |
| 220 | 193 | Allow: /tutor |
| 221 | 194 | Disallow: /tutor/admin |
| 222 | 195 | Disallow: /tutor/search/problems |
| @@ -238,18 +211,6 @@ | ||
| 238 | 211 | Allow: /video/video_sitemap_*.xml |
| 239 | 212 | Allow: /video/movies_sitemap_*.xml |
| 240 | 213 | Disallow: /xmlsearch |
| 241 | - Disallow: /yaca | |
| 242 | - Allow: /yaca/$ | |
| 243 | - Allow: /yaca/m/$ | |
| 244 | - Allow: /yaca/m/yca/cat/*/$ | |
| 245 | - Allow: /yaca/*.xml$ | |
| 246 | - Allow: /yaca/cat/*/$ | |
| 247 | - Disallow: /yaca/result.xml | |
| 248 | - Disallow: /yaca/*/tungrp/ | |
| 249 | - Disallow: /yaca/*/time/ | |
| 250 | - Disallow: /yaca/*/geo/ | |
| 251 | - Disallow: /yaca/cat/*/geo/* | |
| 252 | - Disallow: /yaca/*/synt2/ | |
| 253 | 214 | Disallow: /yandsearch |
| 254 | 215 | Disallow: /yca/cy |
| 255 | 216 | Disallow: /soft/distribution |
| @@ -261,15 +222,8 @@ | ||
| 261 | 222 | Disallow: /soft/browsers/?* |
| 262 | 223 | Disallow: /soft/punto/?* |
| 263 | 224 | Disallow: /ie/?* |
| 264 | - Disallow: /element/?* | |
| 265 | - Disallow: /element/*goodbye* | |
| 266 | 225 | Disallow: /soft/*goodbye* |
| 267 | 226 | Disallow: /adult |
| 268 | - Disallow: /sport*?*parent-reqid* | |
| 269 | - Disallow: /mirror*?*parent-reqid* | |
| 270 | - Disallow: /mirror/hide | |
| 271 | - Disallow: /sport*?*ajax=1* | |
| 272 | - Disallow: /mirror*?*ajax=1* | |
| 273 | 227 | Disallow: /addappterless |
| 274 | 228 | Disallow: /archive/api/image.jpg* |
| 275 | 229 | Allow: /archive$ |
| @@ -317,16 +271,13 @@ | ||
| 317 | 271 | |
| 318 | 272 | Sitemap: https://yandex.ru/support/sitemap.xml |
| 319 | 273 | Sitemap: https://yandex.ru/blog/sitemap.xml |
| 320 | - Sitemap: https://yandex.ru/znatoki/sitemap/sitemap-index.xml | |
| 321 | 274 | Sitemap: https://frontend.s3.yandex.net/health/sitemap.xml |
| 322 | - Sitemap: https://yandex.ru/talk/sitemap.xml | |
| 323 | 275 | Sitemap: https://yandex.ru/uslugi/sitemap/sitemap.xml.gz |
| 324 | 276 | Sitemap: https://yandex.ru/turbo/public/sitemap.xml |
| 325 | 277 | Sitemap: https://yandex.ru/tutor/sitemap/?sitemap=sitemap.xml |
| 326 | 278 | Sitemap: https://yandex.ru/turbo/talk-sitemap-index.xml |
| 327 | 279 | Sitemap: https://yandex.ru/games/sitemaps/sitemap.index.xml |
| 328 | 280 | Sitemap: https://yandex.ru/q/sitemap/sitemap-index.xml |
| 329 | - Sitemap: https://yandex.ru/efir/sitemap.xml | |
| 330 | 281 | Sitemap: https://yandex.ru/images/sitemap.xml |
| 331 | 282 | Sitemap: https://yandex.ru/medicine/sitemaps/sitemap.xml |
| 332 | 283 | Sitemap: https://yandex.ru/finance/sitemaps/sitemap.xml |
| @@ -338,7 +289,6 @@ | ||
| 338 | 289 | Disallow: /403.html |
| 339 | 290 | Disallow: /404.html |
| 340 | 291 | Disallow: /500.html |
| 341 | - Disallow: /about.html | |
| 342 | 292 | Disallow: /adddata |
| 343 | 293 | Disallow: /adresa-segmentator |
| 344 | 294 | Disallow: /advanced_engl.html |
| @@ -355,18 +305,10 @@ | ||
| 355 | 305 | Disallow: /articles |
| 356 | 306 | Disallow: /aura/ |
| 357 | 307 | Allow: /aura/promo/ |
| 358 | - Disallow: /autopoet | |
| 359 | 308 | Disallow: /blog/*?text= |
| 360 | 309 | Disallow: /blog/*?tag= |
| 361 | 310 | Disallow: /blog/*/*/* |
| 362 | 311 | Disallow: /blog/punto |
| 363 | - Disallow: /blogs* | |
| 364 | - Allow: /blogs$ | |
| 365 | - Allow: /blogs/$ | |
| 366 | - Allow: /blogs/pad/$ | |
| 367 | - Allow: /blogs/pad$ | |
| 368 | - Disallow: /bus/orders* | |
| 369 | - Disallow: /bus/api/* | |
| 370 | 312 | Disallow: /MAPS/ |
| 371 | 313 | Disallow: /MaPS/ |
| 372 | 314 | Disallow: /MapS/ |
| @@ -378,7 +320,6 @@ | ||
| 378 | 320 | Disallow: /chat |
| 379 | 321 | Disallow: /cgi-bin/ |
| 380 | 322 | Disallow: /cgi/ |
| 381 | - Disallow: /chisla.html | |
| 382 | 323 | Disallow: /clck |
| 383 | 324 | Disallow: /collections/ |
| 384 | 325 | Disallow: /company/*.rss |
| @@ -390,7 +331,6 @@ | ||
| 390 | 331 | Disallow: /cycounter |
| 391 | 332 | Disallow: /dzen |
| 392 | 333 | Disallow: /experiments.xml |
| 393 | - Disallow: /efir | |
| 394 | 334 | Disallow: /formfeedback |
| 395 | 335 | Disallow: /fresh |
| 396 | 336 | Disallow: /goto_issue/ |
| @@ -411,7 +351,6 @@ | ||
| 411 | 351 | Allow: /images/pad/search?text=*&source=morda* |
| 412 | 352 | Allow: /images/pad/search?rpt=imageview |
| 413 | 353 | Disallow: /index_m |
| 414 | - Disallow: /infected | |
| 415 | 354 | Disallow: /iznanka/ |
| 416 | 355 | Disallow: /int_search_summary |
| 417 | 356 | Disallow: /delivery_tracking |
| @@ -442,11 +381,6 @@ | ||
| 442 | 381 | Disallow: /norobot |
| 443 | 382 | Disallow: /opensearch.xml |
| 444 | 383 | Disallow: /padsearch |
| 445 | - Disallow: /patents/ | |
| 446 | - Disallow: /people/* | |
| 447 | - Allow: /people/$ | |
| 448 | - Allow: /people/pad/$ | |
| 449 | - Allow: /people/pad$ | |
| 450 | 384 | Disallow: /person |
| 451 | 385 | Disallow: /podpiska/login.pl |
| 452 | 386 | Disallow: /pogoda/search |
| @@ -495,7 +429,6 @@ | ||
| 495 | 429 | Disallow: /region_map |
| 496 | 430 | Disallow: /regions_list.xml |
| 497 | 431 | Disallow: /regions.html? |
| 498 | - Disallow: /rubric2sport | |
| 499 | 432 | Disallow: /s/ |
| 500 | 433 | Disallow: /save |
| 501 | 434 | Disallow: /safety/? |
| @@ -516,7 +449,6 @@ | ||
| 516 | 449 | Disallow: /setup |
| 517 | 450 | Disallow: /showcaptcha |
| 518 | 451 | Disallow: /sitesearch |
| 519 | - Disallow: /skazki | |
| 520 | 452 | Disallow: /sl/*.html |
| 521 | 453 | Disallow: /soft/extensions/goodbye |
| 522 | 454 | Disallow: /sportagent |
| @@ -538,11 +470,6 @@ | ||
| 538 | 470 | Disallow: /support/search-results/ |
| 539 | 471 | Disallow: /support/praktikum/flow.html |
| 540 | 472 | Disallow: /support/praktikum-english/ |
| 541 | - Disallow: /talk/create | |
| 542 | - Disallow: /talk/api | |
| 543 | - Disallow: /talk/user/*/article | |
| 544 | - Allow: /talk | |
| 545 | - Allow: /talk/user | |
| 546 | 473 | Disallow: /telsearch |
| 547 | 474 | Disallow: /themes |
| 548 | 475 | Disallow: /toggle-experiment |
| @@ -554,9 +481,6 @@ | ||
| 554 | 481 | Disallow: /viewconfig$ |
| 555 | 482 | Disallow: /images/v$ |
| 556 | 483 | Disallow: /images/viewconfig$ |
| 557 | - Allow: /uslugi/* | |
| 558 | - Disallow: /uslugi/cab | |
| 559 | - Disallow: /uslugi/*/category/doctors/ | |
| 560 | 484 | Allow: /tutor |
| 561 | 485 | Disallow: /tutor/admin |
| 562 | 486 | Disallow: /tutor/search/problems |
| @@ -579,18 +503,6 @@ | ||
| 579 | 503 | Allow: /video/video_sitemap_*.xml |
| 580 | 504 | Allow: /video/movies_sitemap_*.xml |
| 581 | 505 | Disallow: /xmlsearch |
| 582 | - Disallow: /yaca | |
| 583 | - Allow: /yaca/$ | |
| 584 | - Allow: /yaca/m/$ | |
| 585 | - Allow: /yaca/m/yca/cat/*/$ | |
| 586 | - Allow: /yaca/*.xml$ | |
| 587 | - Allow: /yaca/cat/*/$ | |
| 588 | - Disallow: /yaca/result.xml | |
| 589 | - Disallow: /yaca/*/tungrp/ | |
| 590 | - Disallow: /yaca/*/time/ | |
| 591 | - Disallow: /yaca/*/geo/ | |
| 592 | - Disallow: /yaca/cat/*/geo/* | |
| 593 | - Disallow: /yaca/*/synt2/ | |
| 594 | 506 | Disallow: /yandsearch |
| 595 | 507 | Disallow: /yca/cy |
| 596 | 508 | Disallow: /soft/distribution |
| @@ -602,15 +514,8 @@ | ||
| 602 | 514 | Disallow: /soft/browsers/?* |
| 603 | 515 | Disallow: /soft/punto/?* |
| 604 | 516 | Disallow: /ie/?* |
| 605 | - Disallow: /element/?* | |
| 606 | - Disallow: /element/*goodbye* | |
| 607 | 517 | Disallow: /soft/*goodbye* |
| 608 | 518 | Disallow: /adult |
| 609 | - Disallow: /sport*?*parent-reqid* | |
| 610 | - Disallow: /mirror*?*parent-reqid* | |
| 611 | - Disallow: /mirror/hide | |
| 612 | - Disallow: /sport*?*ajax=1* | |
| 613 | - Disallow: /mirror*?*ajax=1* | |
| 614 | 519 | Disallow: /addappterless |
| 615 | 520 | Disallow: /archive/api/image.jpg* |
| 616 | 521 | Allow: /archive$ |
| @@ -659,7 +564,6 @@ | ||
| 659 | 564 | Disallow: /403.html |
| 660 | 565 | Disallow: /404.html |
| 661 | 566 | Disallow: /500.html |
| 662 | - Disallow: /about.html | |
| 663 | 567 | Disallow: /adddata |
| 664 | 568 | Disallow: /adresa-segmentator |
| 665 | 569 | Disallow: /advanced_engl.html |
| @@ -678,18 +582,10 @@ | ||
| 678 | 582 | Disallow: /articles |
| 679 | 583 | Disallow: /aura/ |
| 680 | 584 | Allow: /aura/promo/ |
| 681 | - Disallow: /autopoet | |
| 682 | 585 | Disallow: /blog/*?text= |
| 683 | 586 | Disallow: /blog/*?tag= |
| 684 | 587 | Disallow: /blog/*/*/* |
| 685 | 588 | Disallow: /blog/punto |
| 686 | - Disallow: /blogs* | |
| 687 | - Allow: /blogs$ | |
| 688 | - Allow: /blogs/$ | |
| 689 | - Allow: /blogs/pad/$ | |
| 690 | - Allow: /blogs/pad$ | |
| 691 | - Disallow: /bus/orders* | |
| 692 | - Disallow: /bus/api/* | |
| 693 | 589 | Disallow: /MAPS/ |
| 694 | 590 | Disallow: /MaPS/ |
| 695 | 591 | Disallow: /MapS/ |
| @@ -699,7 +595,6 @@ | ||
| 699 | 595 | Disallow: /chat |
| 700 | 596 | Disallow: /cgi-bin/ |
| 701 | 597 | Disallow: /cgi/ |
| 702 | - Disallow: /chisla.html | |
| 703 | 598 | Disallow: /clck |
| 704 | 599 | Disallow: /collections/ |
| 705 | 600 | Disallow: /company/*.rss |
| @@ -713,7 +608,6 @@ | ||
| 713 | 608 | Disallow: /cycounter |
| 714 | 609 | Disallow: /dzen |
| 715 | 610 | Disallow: /experiments.xml |
| 716 | - Disallow: /efir | |
| 717 | 611 | Disallow: /formfeedback |
| 718 | 612 | Disallow: /fresh |
| 719 | 613 | Disallow: /games/*?experimental= |
| @@ -734,7 +628,6 @@ | ||
| 734 | 628 | Allow: /images/pad/search?text=*&source=morda* |
| 735 | 629 | Allow: /images/pad/search?rpt=imageview |
| 736 | 630 | Disallow: /index_m |
| 737 | - Disallow: /infected | |
| 738 | 631 | Disallow: /iznanka/ |
| 739 | 632 | Disallow: /int_search_summary |
| 740 | 633 | Disallow: /delivery_tracking |
| @@ -767,11 +660,6 @@ | ||
| 767 | 660 | Disallow: /norobot |
| 768 | 661 | Disallow: /opensearch.xml |
| 769 | 662 | Disallow: /padsearch |
| 770 | - Disallow: /patents/ | |
| 771 | - Disallow: /people/* | |
| 772 | - Allow: /people/$ | |
| 773 | - Allow: /people/pad/$ | |
| 774 | - Allow: /people/pad$ | |
| 775 | 663 | Disallow: /person |
| 776 | 664 | Disallow: /podpiska/login.pl |
| 777 | 665 | Disallow: /pogoda/amp/* |
| @@ -814,7 +702,6 @@ | ||
| 814 | 702 | Disallow: /region_map |
| 815 | 703 | Disallow: /regions_list.xml |
| 816 | 704 | Disallow: /regions.html? |
| 817 | - Disallow: /rubric2sport | |
| 818 | 705 | Disallow: /s/ |
| 819 | 706 | Disallow: /save |
| 820 | 707 | Disallow: /safety/?* |
| @@ -823,7 +710,6 @@ | ||
| 823 | 710 | Disallow: /setup |
| 824 | 711 | Disallow: /showcaptcha |
| 825 | 712 | Disallow: /sitesearch |
| 826 | - Disallow: /skazki | |
| 827 | 713 | Disallow: /sl/*.html |
| 828 | 714 | Disallow: /soft/extensions/goodbye |
| 829 | 715 | Disallow: /sportagent |
| @@ -845,11 +731,6 @@ | ||
| 845 | 731 | Disallow: /support/search-results/ |
| 846 | 732 | Disallow: /support/praktikum/flow.html |
| 847 | 733 | Disallow: /support/praktikum-english/ |
| 848 | - Disallow: /talk/create | |
| 849 | - Disallow: /talk/api | |
| 850 | - Disallow: /talk/user/*/article | |
| 851 | - Allow: /talk | |
| 852 | - Allow: /talk/user | |
| 853 | 734 | Disallow: /telsearch |
| 854 | 735 | Disallow: /themes |
| 855 | 736 | Disallow: /toggle-experiment |
| @@ -865,9 +746,6 @@ | ||
| 865 | 746 | Disallow: /viewconfig$ |
| 866 | 747 | Disallow: /images/v$ |
| 867 | 748 | Disallow: /images/viewconfig$ |
| 868 | - Disallow: /uslugi/* | |
| 869 | - Disallow: /uslugi/cab | |
| 870 | - Disallow: /uslugi/*/category/doctors/ | |
| 871 | 749 | Disallow: /versions |
| 872 | 750 | Disallow: /video/* |
| 873 | 751 | Allow: /video/$ |
| @@ -884,18 +762,6 @@ | ||
| 884 | 762 | Allow: /video/video_sitemap_*.xml |
| 885 | 763 | Allow: /video/movies_sitemap_*.xml |
| 886 | 764 | Disallow: /xmlsearch |
| 887 | - Disallow: /yaca | |
| 888 | - Allow: /yaca/$ | |
| 889 | - Allow: /yaca/m/$ | |
| 890 | - Allow: /yaca/m/yca/cat/*/$ | |
| 891 | - Allow: /yaca/*.xml$ | |
| 892 | - Allow: /yaca/cat/*/$ | |
| 893 | - Disallow: /yaca/result.xml | |
| 894 | - Disallow: /yaca/*/tungrp/ | |
| 895 | - Disallow: /yaca/*/time/ | |
| 896 | - Disallow: /yaca/*/geo/ | |
| 897 | - Disallow: /yaca/cat/*/geo/* | |
| 898 | - Disallow: /yaca/*/synt2/ | |
| 899 | 765 | Disallow: /yandsearch |
| 900 | 766 | Disallow: /yca/cy |
| 901 | 767 | Disallow: /soft/distribution |
| @@ -907,8 +773,6 @@ | ||
| 907 | 773 | Disallow: /soft/browsers/?* |
| 908 | 774 | Disallow: /soft/punto/?* |
| 909 | 775 | Disallow: /ie/?* |
| 910 | - Disallow: /element/?* | |
| 911 | - Disallow: /element/*goodbye* | |
| 912 | 776 | Disallow: /soft/*goodbye* |
| 913 | 777 | Disallow: /adult |
| 914 | 778 | Disallow: /addappterless |
| @@ -936,7 +800,6 @@ | ||
| 936 | 800 | Disallow: /403.html |
| 937 | 801 | Disallow: /404.html |
| 938 | 802 | Disallow: /500.html |
| 939 | - Disallow: /about.html | |
| 940 | 803 | Disallow: /adddata |
| 941 | 804 | Disallow: /adresa-segmentator |
| 942 | 805 | Disallow: /advanced_engl.html |
| @@ -957,18 +820,10 @@ | ||
| 957 | 820 | Disallow: /archive/search |
| 958 | 821 | Disallow: /aura/ |
| 959 | 822 | Allow: /aura/promo/ |
| 960 | - Disallow: /autopoet | |
| 961 | 823 | Disallow: /blog/*?text= |
| 962 | 824 | Disallow: /blog/*?tag= |
| 963 | 825 | Disallow: /blog/*/*/* |
| 964 | 826 | Disallow: /blog/punto |
| 965 | - Disallow: /blogs* | |
| 966 | - Allow: /blogs$ | |
| 967 | - Allow: /blogs/$ | |
| 968 | - Allow: /blogs/pad/$ | |
| 969 | - Allow: /blogs/pad$ | |
| 970 | - Disallow: /bus/orders* | |
| 971 | - Disallow: /bus/api/* | |
| 972 | 827 | Disallow: /business/widget |
| 973 | 828 | Disallow: /MAPS/ |
| 974 | 829 | Disallow: /MaPS/ |
| @@ -980,7 +835,6 @@ | ||
| 980 | 835 | Disallow: /catalog/?text= |
| 981 | 836 | Disallow: /cgi-bin/ |
| 982 | 837 | Disallow: /cgi/ |
| 983 | - Disallow: /chisla.html | |
| 984 | 838 | Disallow: /clck |
| 985 | 839 | Disallow: /collections/ |
| 986 | 840 | Disallow: /company/*.rss |
| @@ -992,7 +846,6 @@ | ||
| 992 | 846 | Disallow: /cycounter |
| 993 | 847 | Disallow: /dzen |
| 994 | 848 | Disallow: /experiments.xml |
| 995 | - Disallow: /efir | |
| 996 | 849 | Disallow: /formfeedback |
| 997 | 850 | Disallow: /fresh |
| 998 | 851 | Disallow: /goto_issue/ |
| @@ -1017,7 +870,6 @@ | ||
| 1017 | 870 | |
| 1018 | 871 | Allow: /images/sitemap |
| 1019 | 872 | Disallow: /index_m |
| 1020 | - Disallow: /infected | |
| 1021 | 873 | Disallow: /iznanka/ |
| 1022 | 874 | Disallow: /int_search_summary |
| 1023 | 875 | Disallow: /delivery_tracking |
| @@ -1049,11 +901,6 @@ | ||
| 1049 | 901 | Disallow: /norobot |
| 1050 | 902 | Disallow: /opensearch.xml |
| 1051 | 903 | Disallow: /padsearch |
| 1052 | - Disallow: /patents/ | |
| 1053 | - Disallow: /people/* | |
| 1054 | - Allow: /people/$ | |
| 1055 | - Allow: /people/pad/$ | |
| 1056 | - Allow: /people/pad$ | |
| 1057 | 904 | Allow: /products/sitemaps/new/* |
| 1058 | 905 | Disallow: /person |
| 1059 | 906 | Disallow: /podpiska/login.pl |
| @@ -1103,7 +950,6 @@ | ||
| 1103 | 950 | Disallow: /region_map |
| 1104 | 951 | Disallow: /regions_list.xml |
| 1105 | 952 | Disallow: /regions.html? |
| 1106 | - Disallow: /rubric2sport | |
| 1107 | 953 | Disallow: /s/ |
| 1108 | 954 | Disallow: /save |
| 1109 | 955 | Disallow: /safety/? |
| @@ -1124,7 +970,6 @@ | ||
| 1124 | 970 | Disallow: /setup |
| 1125 | 971 | Disallow: /showcaptcha |
| 1126 | 972 | Disallow: /sitesearch |
| 1127 | - Disallow: /skazki | |
| 1128 | 973 | Disallow: /sl/*.html |
| 1129 | 974 | Disallow: /soft/extensions/goodbye |
| 1130 | 975 | Disallow: /sportagent |
| @@ -1146,11 +991,6 @@ | ||
| 1146 | 991 | Disallow: /support/search-results/ |
| 1147 | 992 | Disallow: /support/praktikum/flow.html |
| 1148 | 993 | Disallow: /support/praktikum-english/ |
| 1149 | - Disallow: /talk/create | |
| 1150 | - Disallow: /talk/api | |
| 1151 | - Disallow: /talk/user/*/article | |
| 1152 | - Allow: /talk | |
| 1153 | - Allow: /talk/user | |
| 1154 | 994 | Disallow: /telsearch |
| 1155 | 995 | Disallow: /themes |
| 1156 | 996 | Disallow: /toggle-experiment |
| @@ -1163,9 +1003,6 @@ | ||
| 1163 | 1003 | Disallow: /viewconfig$ |
| 1164 | 1004 | Disallow: /images/v$ |
| 1165 | 1005 | Disallow: /images/viewconfig$ |
| 1166 | - Allow: /uslugi/* | |
| 1167 | - Disallow: /uslugi/cab | |
| 1168 | - Disallow: /uslugi/*/category/doctors/ | |
| 1169 | 1006 | Allow: /tutor |
| 1170 | 1007 | Disallow: /tutor/admin |
| 1171 | 1008 | Disallow: /tutor/search/problems |
| @@ -1189,18 +1026,6 @@ | ||
| 1189 | 1026 | Allow: /video/video_sitemap_*.xml |
| 1190 | 1027 | Allow: /video/movies_sitemap_*.xml |
| 1191 | 1028 | Disallow: /xmlsearch |
| 1192 | - Disallow: /yaca | |
| 1193 | - Allow: /yaca/$ | |
| 1194 | - Allow: /yaca/m/$ | |
| 1195 | - Allow: /yaca/m/yca/cat/*/$ | |
| 1196 | - Allow: /yaca/*.xml$ | |
| 1197 | - Allow: /yaca/cat/*/$ | |
| 1198 | - Disallow: /yaca/result.xml | |
| 1199 | - Disallow: /yaca/*/tungrp/ | |
| 1200 | - Disallow: /yaca/*/time/ | |
| 1201 | - Disallow: /yaca/*/geo/ | |
| 1202 | - Disallow: /yaca/cat/*/geo/* | |
| 1203 | - Disallow: /yaca/*/synt2/ | |
| 1204 | 1029 | Disallow: /yandsearch |
| 1205 | 1030 | Disallow: /yca/cy |
| 1206 | 1031 | Disallow: /soft/distribution |
| @@ -1212,15 +1037,8 @@ | ||
| 1212 | 1037 | Disallow: /soft/browsers/?* |
| 1213 | 1038 | Disallow: /soft/punto/?* |
| 1214 | 1039 | Disallow: /ie/?* |
| 1215 | - Disallow: /element/?* | |
| 1216 | - Disallow: /element/*goodbye* | |
| 1217 | 1040 | Disallow: /soft/*goodbye* |
| 1218 | 1041 | Disallow: /adult |
| 1219 | - Disallow: /sport*?*parent-reqid* | |
| 1220 | - Disallow: /mirror*?*parent-reqid* | |
| 1221 | - Disallow: /mirror/hide | |
| 1222 | - Disallow: /sport*?*ajax=1* | |
| 1223 | - Disallow: /mirror*?*ajax=1* | |
| 1224 | 1042 | Disallow: /addappterless |
| 1225 | 1043 | Disallow: /archive/api/image.jpg* |
| 1226 | 1044 | Allow: /archive$ |
| @@ -1266,16 +1084,12 @@ | ||
| 1266 | 1084 | Sitemap: https://yandex.ru/pogoda/sitemap-index.xml |
| 1267 | 1085 | Sitemap: https://yandex.ru/support/sitemap.xml |
| 1268 | 1086 | Sitemap: https://yandex.ru/blog/sitemap.xml |
| 1269 | - Sitemap: https://yandex.ru/znatoki/sitemap/sitemap-index.xml | |
| 1270 | 1087 | Sitemap: https://frontend.s3.yandex.net/health/sitemap.xml |
| 1271 | - Sitemap: https://yandex.ru/talk/sitemap.xml | |
| 1272 | 1088 | Sitemap: https://yandex.ru/uslugi/sitemap/sitemap.xml.gz |
| 1273 | 1089 | Sitemap: https://yandex.ru/turbo/public/sitemap.xml |
| 1274 | 1090 | Sitemap: https://yandex.ru/tutor/sitemap/?sitemap=sitemap.xml |
| 1275 | - Sitemap: https://yandex.ru/turbo/talk-sitemap-index.xml | |
| 1276 | 1091 | Sitemap: https://yandex.ru/games/sitemaps/sitemap.index.xml |
| 1277 | 1092 | Sitemap: https://yandex.ru/q/sitemap/sitemap-index.xml |
| 1278 | - Sitemap: https://yandex.ru/efir/sitemap.xml | |
| 1279 | 1093 | Sitemap: https://yandex.ru/images/sitemap.xml |
| 1280 | 1094 | Sitemap: https://yandex.ru/medicine/sitemaps/sitemap.xml |
| 1281 | 1095 | Sitemap: https://yandex.ru/yandexapp/ru/callerid/sitemap.xml |
| @@ -1287,10 +1101,6 @@ | ||
| 1287 | 1101 | |
| 1288 | 1102 | Clean-Param: ncrnd&redircnt&clid&_&win / |
| 1289 | 1103 | Clean-Param: utm_source&utm_medium&utm_campaign&utm_term&utm_content&utm_nooverride&utm_expid&gclid&_openstat&yclid&gsaid&_gs_rmark&_gs_ref&_gs_cttl&iframe /health/ |
| 1290 | - Clean-Param: p&msp&occupationId&specId&serviceId&rubric&afterWorkerPage&clarifier&create_order&workerId&categoryId&specializationId&title&onlyForInvited&price&priceMeasure&isPromotion&from&source®ion&max_reactions_count&adbody&adurl&backpath&query&saas_webreqid&action&displayid&promoAction&ref&orderId&utm&ig_source&creative&campaignid&adgroupid&worker_id&order_access_key&push_id&intent&family&status&t&tss&utm_campa&utm_left&utm_sup_project&utm_sup_source&utm_sup_type&yhid /uslugi/* | |
| 1291 | - Clean-Param: view&lonlat&span&baobab_event_id&etext&q&wizextra&utm_source&utm_medium&utm_campaign&utm_content&yclid&utm_term&clid&wprid&yaclid&id&noreask&retflag&type&completely_moderated&address_type&yandex_ad_order_id&acton&yandex_ad_client_id&idkey&city&geoname_exact&phone&repeatOrderId&call_center&retpath&exp_boxes&gref&referrer&cc&keyword&fyandex&state&code&description&template&s&lr®ion_id&onboardingStep&bathroom&room&&createCleaningStep&selfieType&address&customerName /uslugi/* | |
| 1292 | - Clean-Param: afterRegistration&gclid&selfieStep&whenGoDatetime&form_source&utm_from&queryReason&complainOrderId&cleaningCustomFormStep&review&customerEmail&disableHeader&detectParams&sort_by&fn&showCustomerPhone&sort_order&am_social&utm_sourc&distr_type&i&vid&fp&name&z&mclid&n&tkn&ut&pp&utm_so&fromQrCode&searchable&puid&utm_cgid&collectionId&go&m&redircnt&surname&useAddress&_aid&ard&c&cardId&cbir_page&cliff&language&list&cbird&ts&utm_m&w&country&Brow&banerid&eea&o&plc&utm_campaig /uslugi/* | |
| 1293 | - Clean-Param: index&is_copy_url&utm_med&is_from_webapp&ncrnd&rpt&smartleads_src&url&utm_me&_prevcmd&cmbck&dedica&gbraid&lc&smartleads_pid&utm_&displayId /uslugi/* | |
| 1294 | 1104 | Clean-Param: print=1 /tutor/ |
| 1295 | 1105 | Clean-Param: w&w_question_id /q/question/* |
| 1296 | 1106 | Clean-Param: &appsearch_header=1&comments=1 /news/story/ |