NeuralCrawl

Shutterstock / robots.txt

← back to shutterstock.com · change detected 3mo ago (2026-08-06T19:27:21Z) · modified +16 −8

What changed

Diff old (2026-06-20T01:10:31Z) → new (2026-08-06T19:27:21Z)

@@ -45,8 +45,10 @@
4545  Disallow: /cart
4646  Disallow: */search/ris/*
4747  Disallow: */search/models/*
48- Disallow: /search/personalized/*
49- Disallow: /search/similar/*
48+ Disallow: /search/personalized/
49+ Disallow: /*/search/personalized/
50+ Disallow: /search/similar/
51+ Disallow: /*/search/similar/
5052 
5153  # Editor Images
5254  Disallow: */editor/image/*
@@ -113,8 +115,10 @@
113115  Disallow: /cart
114116  Disallow: */search/ris/*
115117  Disallow: */search/models/*
116- Disallow: /search/personalized/*
117- Disallow: /search/similar/*
118+ Disallow: /search/personalized/
119+ Disallow: /*/search/personalized/
120+ Disallow: /search/similar/
121+ Disallow: /*/search/similar/
118122  Disallow: */editor/image/*
119123  Allow: */editor/image/$
120124 
@@ -165,8 +169,10 @@
165169  Disallow: /cart
166170  Disallow: */search/ris/*
167171  Disallow: */search/models/*
168- Disallow: /search/personalized/*
169- Disallow: /search/similar/*
172+ Disallow: /search/personalized/
173+ Disallow: /*/search/personalized/
174+ Disallow: /search/similar/
175+ Disallow: /*/search/similar/
170176  Disallow: */editor/image/*
171177  Allow: */editor/image/$
172178 
@@ -217,8 +223,10 @@
217223  Disallow: /cart
218224  Disallow: */search/ris/*
219225  Disallow: */search/models/*
220- Disallow: /search/personalized/*
221- Disallow: /search/similar/*
226+ Disallow: /search/personalized/
227+ Disallow: /*/search/personalized/
228+ Disallow: /search/similar/
229+ Disallow: /*/search/similar/
222230  Disallow: */editor/image/*
223231  Allow: */editor/image/$
224232