NeuralCrawl

Vinci / robots.txt

← back to vinci.com · change detected 1mo ago (2026-06-23T15:50:08Z) · modified +28 −5

What changed

Diff old (2026-06-20T01:10:30Z)new (2026-06-23T15:50:08Z)

@@ -37,19 +37,42 @@
3737  Disallow: /core/
3838  Disallow: /profiles/
3939  # Files
40- Disallow: /README.txt
40+ Disallow: /README.md
41+ Disallow: /composer/Metapackage/README.txt
42+ Disallow: /composer/Plugin/ProjectMessage/README.md
43+ Disallow: /composer/Plugin/Scaffold/README.md
44+ Disallow: /composer/Plugin/VendorHardening/README.txt
45+ Disallow: /composer/Template/README.txt
46+ Disallow: /modules/README.txt
47+ Disallow: /sites/README.txt
48+ Disallow: /themes/README.txt
4149  # Paths (clean URLs)
4250  Disallow: /admin/
4351  Disallow: /comment/reply/
4452  Disallow: /filter/tips
4553  Disallow: /node/add/
4654  Disallow: /search/
47- Disallow: /user/register/
48- Disallow: /user/password/
49- Disallow: /user/login/
50- Disallow: /user/logout/
55+ Disallow: /user/register
56+ Disallow: /user/password
57+ Disallow: /user/login
58+ Disallow: /user/logout
59+ Disallow: /media/oembed
60+ Disallow: /*/media/oembed
5161  # Paths (no clean URLs)
62+ Disallow: /index.php/admin/
63+ Disallow: /index.php/comment/reply/
64+ Disallow: /index.php/filter/tips
65+ Disallow: /index.php/node/add/
66+ Disallow: /index.php/search/
67+ Disallow: /index.php/user/password
68+ Disallow: /index.php/user/register
69+ Disallow: /index.php/user/login
70+ Disallow: /index.php/user/logout
71+ Disallow: /index.php/media/oembed
72+ Disallow: /index.php/*/media/oembed
73+
5274  Disallow: /index.php/*
75+
5376  # Deprecated urls
5477  Disallow: /vinci.nsf/*
5578