NeuralCrawl

PG&E / robots.txt snapshot

← back to pge.com · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 901 bytes · sha256 2f739177753a51d6 · raw

final URL: https://www.pge.com/robots.txt

1User-agent: NinjaBot
2User-Agent: W3C-checklink
3Allow: /
4User-agent: GPTBot
5Disallow: /
6User-Agent:*
7Disallow: /mobile/
8Disallow: /mobile_jbri/
9
10Sitemap: https://www.pge.com/en.sitemap.xml
11Sitemap: https://www.pge.com/es.sitemap.xml
12Sitemap: https://www.pge.com/pt.sitemap.xml
13Sitemap: https://www.pge.com/ko.sitemap.xml
14Sitemap: https://www.pge.com/ja.sitemap.xml
15Sitemap: https://www.pge.com/zh.sitemap.xml
16Sitemap: https://www.pge.com/ar.sitemap.xml
17Sitemap: https://www.pge.com/vi.sitemap.xml
18Sitemap: https://www.pge.com/fa.sitemap.xml
19Sitemap: https://www.pge.com/hi.sitemap.xml
20Sitemap: https://www.pge.com/ru.sitemap.xml
21Sitemap: https://www.pge.com/th.sitemap.xml
22Sitemap: https://www.pge.com/tl.sitemap.xml
23Sitemap: https://www.pge.com/pa.sitemap.xml
24Sitemap: https://www.pge.com/km.sitemap.xml
25Sitemap: https://www.pge.com/hmn.sitemap.xml
26Sitemap: https://www.pge.com/tariffs/en.sitemap.xml