Bank Central Asia / robots.txt
← back to bca.co.id · change detected 1mo ago (2026-09-22T10:23:37Z) · modified +9 −0
What changed
- 🤖 AIAdded rules for AI crawler ClaudeBot (Anthropic)
- 🤖 AIAdded rules for AI crawler GPTBot (OpenAI)
- 🤖 AIAdded rules for AI crawler OAI-SearchBot (OpenAI)
Diff old (2026-09-19T21:44:20Z) → new (2026-09-22T10:23:37Z)
| @@ -9,4 +9,13 @@ | ||
| 9 | 9 | Disallow: /id/Campaign/promo-imlek/ |
| 10 | 10 | Disallow: /Syarat-dan-Ketentuan/keybca-softtoken/ |
| 11 | 11 | |
| 12 | + User-agent: GPTBot | |
| 13 | + Disallow: /id/Forms/Ext/event-bca | |
| 14 | + | |
| 15 | + User-agent: ClaudeBot | |
| 16 | + Disallow: /id/Forms/Ext/event-bca | |
| 17 | + | |
| 18 | + User-agent: OAI-SearchBot | |
| 19 | + Disallow: /id/Forms/Ext/event-bca | |
| 20 | + | |
| 12 | 21 | Sitemap: http://www.bca.co.id/sitemap.xml |