Heidelberg Materials / robots.txt
← back to heidelbergmaterials.com · change detected 1mo ago (2026-07-06T20:20:23Z) · modified +3 −0
What changed
- Formatting/comment-only change (no semantic difference)
Diff old (2026-06-20T01:10:30Z) → new (2026-07-06T20:20:23Z)
| @@ -80,3 +80,6 @@ | ||
| 80 | 80 | |
| 81 | 81 | User-agent: AhrefsSiteAudit |
| 82 | 82 | Crawl-delay: 10 |
| 83 | + | |
| 84 | + # Content-Signals | |
| 85 | + Content-Signal: search=yes, ai-train=yes, ai-input=yes |