NeuralCrawl

REWE Group / robots.txt snapshot

← back to rewe-group.com · fetched 2026-06-20T01:10:30Z (15h ago) · HTTP 200 · 650 bytes · sha256 b6e12a708877dc02 · raw

final URL: https://www.rewe-group.com/robots.txt

1User-agent: *
2Disallow: /wp-admin/
3Disallow: /wp-includes/
4Disallow: /wp-login.php
5Disallow: /cms/wp-admin/
6Disallow: /cms/wp-includes/
7Disallow: /cms/wp-login.php
8Disallow: /de/wp-admin/
9Disallow: /de/wp-includes/
10Disallow: /de/wp-login.php
11Disallow: /de/cms/wp-admin/
12Disallow: /de/cms/wp-includes/
13Disallow: /de/cms/wp-login.php
14Disallow: /en/wp-admin/
15Disallow: /en/wp-includes/
16Disallow: /en/wp-login.php
17Disallow: /en/cms/wp-admin/
18Disallow: /en/cms/wp-includes/
19Disallow: /en/cms/wp-login.php
20
21User-agent: bingbot
22Disallow: /pensionskasse/
23
24Sitemap: https://www.rewe-group.com/de/sitemap.xml
25Sitemap: https://www.rewe-group.com/en/sitemap.xml