NeuralCrawl

Lincoln Financial / robots.txt snapshot

← back to lincolnfinancial.com · fetched 2026-06-20T01:10:31Z (18h ago) · HTTP 200 · 316 bytes · sha256 c49bfee05e13eb5a · raw

final URL: https://www.lincolnfinancial.com/robots.txt

1User-agent: *
2Disallow: /scripts/
3Disallow: /assets/*
4Disallow: /sites/*
5Disallow: /cas/*
6Disallow: /error/*
7Crawl-delay: 10
8
9
10User-agent: Screaming Frog SEO Spider/9.1
11Allow: /
12Disallow: /sites/Satellite?c*
13Disallow: /sites/Satellite?pagename*
14Crawl-delay: 10
15
16Sitemap: https://www.lincolnfinancial.com/sitemap.xml