Commonwealth Bank / robots.txt
← back to commbank.com.au · change detected 1d ago (2026-09-18T09:19:18Z) · modified +4 −1
What changed
- Added Allow: /etc/designs/commbank/favicon.ico for *
- 🤖 AIAdded Allow: /digital/home-loans/borrowing-power-calculator for Amazonbot
- 🤖 AIAdded Allow: /etc/designs/commbank/favicon.ico for Amazonbot
- 🤖 AIAdded Allow: /digital/home-loans/borrowing-power-calculator for Applebot-Extended
- 🤖 AIAdded Allow: /etc/designs/commbank/favicon.ico for Applebot-Extended
- 🤖 AIAdded Allow: /digital/home-loans/borrowing-power-calculator for Bytespider
- 🤖 AIAdded Allow: /etc/designs/commbank/favicon.ico for Bytespider
- 🤖 AIAdded Allow: /digital/home-loans/borrowing-power-calculator for CCBot
- 🤖 AIAdded Allow: /etc/designs/commbank/favicon.ico for CCBot
- 🤖 AIAdded Allow: /digital/home-loans/borrowing-power-calculator for ChatGPT-User
- 🤖 AIAdded Allow: /etc/designs/commbank/favicon.ico for ChatGPT-User
- 🤖 AIAdded Allow: /digital/home-loans/borrowing-power-calculator for Claude-SearchBot
- 🤖 AIAdded Allow: /etc/designs/commbank/favicon.ico for Claude-SearchBot
- 🤖 AIAdded Allow: /digital/home-loans/borrowing-power-calculator for Claude-User
- 🤖 AIAdded Allow: /etc/designs/commbank/favicon.ico for Claude-User
- 🤖 AIAdded Allow: /digital/home-loans/borrowing-power-calculator for ClaudeBot
- 🤖 AIAdded Allow: /etc/designs/commbank/favicon.ico for ClaudeBot
- 🤖 AIAdded Allow: /digital/home-loans/borrowing-power-calculator for cohere-ai
- 🤖 AIAdded Allow: /etc/designs/commbank/favicon.ico for cohere-ai
- 🤖 AIAdded Allow: /digital/home-loans/borrowing-power-calculator for Diffbot
- 🤖 AIAdded Allow: /etc/designs/commbank/favicon.ico for Diffbot
- 🤖 AIAdded Allow: /digital/home-loans/borrowing-power-calculator for Google-Extended
- 🤖 AIAdded Allow: /etc/designs/commbank/favicon.ico for Google-Extended
- 🤖 AIAdded Allow: /digital/home-loans/borrowing-power-calculator for GPTBot
- 🤖 AIAdded Allow: /etc/designs/commbank/favicon.ico for GPTBot
- 🤖 AIAdded Allow: /digital/home-loans/borrowing-power-calculator for Meta-ExternalAgent
- 🤖 AIAdded Allow: /etc/designs/commbank/favicon.ico for Meta-ExternalAgent
- 🤖 AIAdded Allow: /digital/home-loans/borrowing-power-calculator for OAI-SearchBot
- 🤖 AIAdded Allow: /etc/designs/commbank/favicon.ico for OAI-SearchBot
- 🤖 AIAdded Allow: /digital/home-loans/borrowing-power-calculator for Perplexity-User
- 🤖 AIAdded Allow: /etc/designs/commbank/favicon.ico for Perplexity-User
- 🤖 AIAdded Allow: /digital/home-loans/borrowing-power-calculator for PerplexityBot
- 🤖 AIAdded Allow: /etc/designs/commbank/favicon.ico for PerplexityBot
- 🤖 AIAdded Allow: /digital/home-loans/borrowing-power-calculator for Timpibot
- 🤖 AIAdded Allow: /etc/designs/commbank/favicon.ico for Timpibot
Diff old (2026-09-09T06:19:28Z) → new (2026-09-18T09:19:18Z)
| @@ -1,6 +1,6 @@ | ||
| 1 | 1 | # robots.txt — commbank.com.au |
| 2 | 2 | # Owner: robots |
| 3 | - # Last reviewed: 2026-08-04 | |
| 3 | + # Last reviewed: 2026-09-18 | |
| 4 | 4 | |
| 5 | 5 | # --------------------------------------------------------------- |
| 6 | 6 | # 1. AI / LLM crawlers — training and retrieval |
| @@ -29,10 +29,12 @@ | ||
| 29 | 29 | Allow: / |
| 30 | 30 | |
| 31 | 31 | Disallow: /netbank/ |
| 32 | + Allow: /digital/home-loans/borrowing-power-calculator | |
| 32 | 33 | Disallow: /digital/ |
| 33 | 34 | Disallow: /retail/complaints-compliments-form/ |
| 34 | 35 | Disallow: /content/api/ |
| 35 | 36 | Disallow: /bin/ |
| 37 | + Allow: /etc/designs/commbank/favicon.ico | |
| 36 | 38 | Disallow: /etc/ |
| 37 | 39 | Disallow: /content/dam/commbank/corporate/research/restricted/ |
| 38 | 40 | |
| @@ -65,6 +67,7 @@ | ||
| 65 | 67 | |
| 66 | 68 | Disallow: /bin/ |
| 67 | 69 | Disallow: /etc/ |
| 70 | + Allow: /etc/designs/commbank/favicon.ico | |
| 68 | 71 | Disallow: /content/api/ |
| 69 | 72 | Disallow: /content/campaigns/ |
| 70 | 73 | Disallow: /tiles/ |