Heidelberg Materials / robots.txt
← back to heidelbergmaterials.com · change detected 1mo ago (2026-07-07T20:35:12Z) · modified +0 −3
What changed
- Formatting/comment-only change (no semantic difference)
Diff old (2026-07-07T14:29:28Z) → new (2026-07-07T20:35:12Z)
| @@ -80,6 +80,3 @@ | ||
| 80 | 80 | |
| 81 | 81 | User-agent: AhrefsSiteAudit |
| 82 | 82 | Crawl-delay: 10 |
| 83 | - | |
| 84 | - # Content-Signals | |
| 85 | - Content-Signal: search=yes, ai-train=yes, ai-input=yes |