User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: Google-Extended Disallow: / User-agent: PerplexityBot Disallow: / User-agent: Amazonbot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Omgilibot Disallow: / User-Agent: FacebookBot Disallow: / User-Agent: Appleby Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Bytespider Disallow: / User-agent: Claude-Web # Only allow URLs generated with frontend routing Disallow: /*?id=* Disallow: /*&id=* # Language (for single language config) Disallow: /*?L=0* Disallow: /*&L=0* Disallow: /*?L=1* Disallow: /*&L=1* # Private folder (should always be protected by .htaccess) Disallow: /*/Private/* Disallow: /*/Configuration/* Disallow: /*cHash=* Disallow: /*&type=300* Disallow: /*&type=26841* Disallow: /*tx_powermail_pi1* # Temp files Disallow: /typo3temp/ Allow: /typo3temp/*.css Allow: /typo3temp/*.css.*.gzip Allow: /typo3temp/*.js Allow: /typo3temp/*.js.*.gzip Allow: /typo3temp/*.jpg Allow: /typo3temp/*.gif Allow: /typo3temp/*.png #sql Disallow: *.sql Disallow: *.sql.gz