Realtor / robots.txt
← back to realtor.com · change detected 3d ago (2026-11-03T19:10:24Z) · modified +39 −3
What changed
- Removed all rules for user-agent ‘bingbot’
- Added Allow: /realestateandhomes-search/*/district/*/* for *
- Added Allow: /realestateandhomes-search/*/district/*/price-na- for *
- Added Allow: /realestateandhomes-search/*/park/*/* for *
- Added Allow: /realestateandhomes-search/*/park/*/price-na- for *
- Added Allow: /realestateandhomes-search/*/schools/*/* for *
- Added Allow: /realestateandhomes-search/*/schools/*/price-na- for *
- Added Allow: /realestateandhomes-search/*/university/*/* for *
- Added Allow: /realestateandhomes-search/*/university/*/price-na- for *
- Added Disallow: /embed/ for *
- Added Disallow: /international/*%25C2 for *
- Added Disallow: /international/*%25C3 for *
- Added Disallow: /international/*// for *
- Added Disallow: /international/*/p1 for *
- Added Disallow: /international/*/p2 for *
- Added Disallow: /international/*/p3 for *
- Added Disallow: /international/*/p4 for *
- Added Disallow: /international/*/p5 for *
- Added Disallow: /international/*/p6 for *
- Added Disallow: /international/*/p7 for *
- Added Disallow: /international/*/p8 for *
- Added Disallow: /international/*/p9 for *
- Added Disallow: /international/*aaaaa for *
- Added Disallow: /realestateandhomes-search/*/*/*/* for *
- Added Disallow: /realestateandhomes-search/*/*/*/*price-na- for *
- Added Disallow: /realestateandhomes-search/*/*/price-na-*/* for *
- Added Disallow: /realestateandhomes-search/*/district/*/*/* for *
- Added Disallow: /realestateandhomes-search/*/district/*/*/*price-na- for *
- Added Disallow: /realestateandhomes-search/*/district/*/price-na-*/* for *
- Added Disallow: /realestateandhomes-search/*/park/*/*/* for *
- Added Disallow: /realestateandhomes-search/*/park/*/*/*price-na- for *
- Added Disallow: /realestateandhomes-search/*/park/*/price-na-*/* for *
- Added Disallow: /realestateandhomes-search/*/price-na-*/*/* for *
- Added Disallow: /realestateandhomes-search/*/schools/*/*/* for *
- Added Disallow: /realestateandhomes-search/*/schools/*/*/*price-na- for *
- Added Disallow: /realestateandhomes-search/*/schools/*/price-na-*/* for *
- Added Disallow: /realestateandhomes-search/*/university/*/*/* for *
- Added Disallow: /realestateandhomes-search/*/university/*/*/*price-na- for *
- Added Disallow: /realestateandhomes-search/*/university/*/price-na-*/* for *
- Removed Allow: /realestateandhomes-search/*price-na- for *
Diff old (2026-10-21T14:45:06Z) → new (2026-11-03T19:10:24Z)
| @@ -1,7 +1,5 @@ | ||
| 1 | 1 | # LEGAL NOTICE: Per https://www.realtor.com's Terms of Service, scraping data from this website is unauthorized without the express written permission from Move Sales, Inc., operator of https://www.realtor.com. |
| 2 | 2 | |
| 3 | - User-agent: bingbot | |
| 4 | - Crawl-delay: 1 | |
| 5 | 3 | |
| 6 | 4 | User-agent: * |
| 7 | 5 | Allow: /news/*?cid= |
| @@ -295,10 +293,48 @@ | ||
| 295 | 293 | Disallow: /living/search/ |
| 296 | 294 | Disallow: /realestateandhomes-detail/*/gallery/ |
| 297 | 295 | Disallow: /realestateandhomes-search/*/price- |
| 298 | - Allow: /realestateandhomes-search/*price-na- | |
| 296 | + Allow: /realestateandhomes-search/*/price-na- | |
| 299 | 297 | Disallow: /realestateandhomes-search/*, |
| 300 | 298 | Disallow: /realestateandhomes-search/*%2C |
| 301 | 299 | Disallow: /realestateandhomes-search/*%2c |
| 300 | + Disallow: /embed/ | |
| 301 | + Disallow: /international/*// | |
| 302 | + Disallow: /international/*/p1 | |
| 303 | + Disallow: /international/*/p2 | |
| 304 | + Disallow: /international/*/p3 | |
| 305 | + Disallow: /international/*/p4 | |
| 306 | + Disallow: /international/*/p5 | |
| 307 | + Disallow: /international/*/p6 | |
| 308 | + Disallow: /international/*/p7 | |
| 309 | + Disallow: /international/*/p8 | |
| 310 | + Disallow: /international/*/p9 | |
| 311 | + Disallow: /international/*aaaaa | |
| 312 | + Disallow: /international/*%25C3 | |
| 313 | + Disallow: /international/*%25C2 | |
| 314 | + Disallow: /realestateandhomes-search/*/*/*/* | |
| 315 | + Disallow: /realestateandhomes-search/*/*/*/*price-na- | |
| 316 | + Disallow: /realestateandhomes-search/*/*/price-na-*/* | |
| 317 | + Disallow: /realestateandhomes-search/*/price-na-*/*/* | |
| 318 | + Allow: /realestateandhomes-search/*/schools/*/* | |
| 319 | + Allow: /realestateandhomes-search/*/schools/*/price-na- | |
| 320 | + Disallow: /realestateandhomes-search/*/schools/*/*/* | |
| 321 | + Disallow: /realestateandhomes-search/*/schools/*/*/*price-na- | |
| 322 | + Disallow: /realestateandhomes-search/*/schools/*/price-na-*/* | |
| 323 | + Allow: /realestateandhomes-search/*/district/*/* | |
| 324 | + Allow: /realestateandhomes-search/*/district/*/price-na- | |
| 325 | + Disallow: /realestateandhomes-search/*/district/*/*/* | |
| 326 | + Disallow: /realestateandhomes-search/*/district/*/*/*price-na- | |
| 327 | + Disallow: /realestateandhomes-search/*/district/*/price-na-*/* | |
| 328 | + Allow: /realestateandhomes-search/*/park/*/* | |
| 329 | + Allow: /realestateandhomes-search/*/park/*/price-na- | |
| 330 | + Disallow: /realestateandhomes-search/*/park/*/*/* | |
| 331 | + Disallow: /realestateandhomes-search/*/park/*/*/*price-na- | |
| 332 | + Disallow: /realestateandhomes-search/*/park/*/price-na-*/* | |
| 333 | + Allow: /realestateandhomes-search/*/university/*/* | |
| 334 | + Allow: /realestateandhomes-search/*/university/*/price-na- | |
| 335 | + Disallow: /realestateandhomes-search/*/university/*/*/* | |
| 336 | + Disallow: /realestateandhomes-search/*/university/*/*/*price-na- | |
| 337 | + Disallow: /realestateandhomes-search/*/university/*/price-na-*/* | |
| 302 | 338 | |
| 303 | 339 | User-agent: Yandex |
| 304 | 340 | Disallow: / |