Google Scholar / robots.txt snapshot
← back to scholar.google.com · fetched 2026-06-26T14:15:22Z (4h ago) · HTTP 200 · 564 bytes · sha256 15a55fbdcbb3aaa7 · raw
final URL: https://scholar.google.com/robots.txt
| 1 | User-agent: * |
| 2 | Disallow: /search |
| 3 | Disallow: /index.html |
| 4 | Disallow: /scholar |
| 5 | Disallow: /citations? |
| 6 | Allow: /citations?user= |
| 7 | Disallow: /citations?*cstart= |
| 8 | Disallow: /citations?user=*%40 |
| 9 | Disallow: /citations?user=*@ |
| 10 | Allow: /citations?view_op=list_classic_articles |
| 11 | Allow: /citations?view_op=mandates_leaderboard |
| 12 | Allow: /citations?view_op=metrics_intro |
| 13 | Allow: /citations?view_op=new_profile |
| 14 | Allow: /citations?view_op=sitemap |
| 15 | Allow: /citations?view_op=top_venues |
| 16 | |
| 17 | User-agent: Twitterbot |
| 18 | Disallow: |
| 19 | |
| 20 | User-agent: facebookexternalhit |
| 21 | Disallow: |
| 22 | |
| 23 | User-agent: PetalBot |
| 24 | Disallow: / |