NeuralCrawl

SAP / robots.txt snapshot

← back to sap.com · fetched 2026-08-31T15:31:09Z (18d ago) · HTTP 200 · 3292 bytes · sha256 3bbb343243e97121 · raw

final URL: https://www.sap.com/robots.txt

1#
2# Welcome to SAP SE
3# ____ _ ____
4#/ ___| / \ | _ \
5#\___ \ / _ \ | |_) |
6# ___) / ___ \| __/
7#|____/_/ \_\_|
8#
9# robots.txt for https://www.sap.com
10#
11# https://www.sap.com/about.html
12#
13# Find your next job: https://www.sap.com/careers
14#
15# Last updated 2026-08-31
16
17User-agent: *
18Disallow: /
19
20# Search Engines & AI Agents (all share the same rule set)
21User-agent: Googlebot
22User-agent: Googlebot-Image
23User-agent: Googlebot-News
24User-agent: Googlebot-Video
25User-agent: GoogleOther
26User-agent: Google-InspectionTool
27User-agent: Storebot-Google
28User-agent: Bingbot
29User-agent: 360Spider
30User-agent: Baiduspider
31User-agent: coccocbot
32User-agent: Daum
33User-agent: DuckDuckBot
34User-agent: Ecosia_bot
35User-agent: MojeekBot
36User-agent: Yeti
37User-agent: SeznamBot
38User-agent: Sogou web spider
39User-agent: Yahoo! Slurp
40User-agent: YandexAccessibilityBot
41User-agent: YandexMobileBot
42User-agent: Yandex
43User-agent: Amazonbot
44User-agent: ClaudeBot
45User-agent: Claude-User
46User-agent: Claude-SearchBot
47User-agent: CCBot
48User-agent: Google-Extended
49User-agent: FacebookBot
50User-agent: MistralAI-User
51User-agent: GPTBot
52User-agent: ChatGPT-User
53User-agent: OAI-SearchBot
54User-agent: PerplexityBot
55User-agent: Perplexity-User
56User-agent: archive.org_bot
57Disallow: /bin/sapdx/
58Disallow: /bin/sapdxc/
59Disallow: /design-system/digital/
60Disallow: /dmc/
61Disallow: /heartbeat.html
62Disallow: /investors/de/stock/fixed-income/bond-documentation*
63Disallow: /investors/de/stock/fixed-income/cp-documentation*
64Disallow: /investors/en/stock/fixed-income/bond-documentation*
65Disallow: /investors/en/stock/fixed-income/cp-documentation*
66Disallow: */_jcr_content*.html
67Disallow: */abm/*
68Disallow: */cmp/dg/gdpr/*
69Disallow: */cmp/dg/gdpr-emea/*
70Disallow: */cmp/dg/gdpr-germany/*
71Disallow: */cmp/eml/*
72Disallow: */cmp/oth/crm-wx18-xrg-geb-fba/*
73Disallow: */cmp/oth/crm-wx18-xrg-geb-supfba/*
74Disallow: */cmp/oth/gdpr-opt-out/*
75Disallow: */cmp/spm/*
76Disallow: */cmp/td/sap-sustainability-data-exchange*
77Disallow: */events/sapphire/orlando/celebration-night-concert.html
78Disallow: */events/sponsorships.html
79Disallow: */legal/video-surveillance*
80Disallow: */products/erp/s4hana-private-edition/trial.html
81Disallow: */tye.html
82Disallow: */typ.html
83Disallow: */registration/*?
84Disallow: /silent.html
85Disallow: /*/silent.html
86Allow: /abm/dod.html
87Allow: /abm/dod/*
88Allow: /dmc/exp/*
89
90# Fetcher and other
91User-agent: AdsBot-Google
92User-agent: AdsBot-Google-Mobile
93User-agent: BrightEdge
94User-agent: Chrome-Lighthouse
95User-agent: facebookexternalhit
96User-agent: Google-Read-Aloud
97User-agent: Google-Safety
98User-agent: Hatena
99User-agent: linkedinbot
100User-agent: Mediapartners-Google
101User-agent: Pinterestbot
102User-agent: SchemaBot
103User-agent: SiteAuditBot
104User-agent: SiteimproveBot
105User-agent: Slackbot-LinkExpanding
106User-agent: Telegram
107User-agent: Twitterbot
108User-agent: Prerender
109Allow: /
110
111Sitemap: https://www.sap.com/sitemap_index.xml
112Sitemap: https://www.sap.com/sitemap-index.xml
113Sitemap: https://www.sap.com/sitemap_siteimprove_index.xml
114Sitemap: https://www.sap.com/sitemap_us_int_only_siteimprove_index.xml
115Sitemap: https://www.sap.com/sitemap_us_int_only_siteimprove.xml
116Sitemap: https://www.sap.com/sitemap-us-int-only-siteimprove.xml
117Sitemap: https://www.sap.com/sitemap_countries_siteimprove.xml