Realtor / robots.txt
← back to realtor.com · change detected 1mo ago (2026-07-01T18:33:05Z) · modified +13 −0
What changed
- Blocked user-agent ‘OAI-AdsBot’ entirely
Diff old (2026-06-26T23:05:56Z) → new (2026-07-01T18:33:05Z)
| @@ -352,6 +352,19 @@ | ||
| 352 | 352 | Allow: /realestateteams/*?cid= |
| 353 | 353 | Allow: /realestateagency/*?cid= |
| 354 | 354 | |
| 355 | + User-agent: OAI-AdsBot | |
| 356 | + Disallow: / | |
| 357 | + Allow: /realestateandhomes-detail/*?cid= | |
| 358 | + Allow: /realestateandhomes-search/*?cid= | |
| 359 | + Allow: /news/*?cid= | |
| 360 | + Allow: /guides/*?cid= | |
| 361 | + Allow: /advice/*?cid= | |
| 362 | + Allow: /living/*?cid= | |
| 363 | + Allow: /realestateagents/*?cid= | |
| 364 | + Allow: /realestateteams/*?cid= | |
| 365 | + Allow: /realestateagency/*?cid= | |
| 366 | + Allow: /myhome/*?cid= | |
| 367 | + | |
| 355 | 368 | Sitemap: https://www.realtor.com/mortgage/sitemap/mortgagesitemap.xml |
| 356 | 369 | Sitemap: https://www.realtor.com/realestateandhomes-detail/sitemap-rss-new/rss-new-index.xml |
| 357 | 370 | Sitemap: https://www.realtor.com/realestateandhomes-detail/sitemap-rss-open-house/rss-open-house-index.xml |