NeuralCrawl — change feed

Figma Community figma.com modified +1 −0 4mo ago

🤖 AI Added Allow: /es-la/blog/in-good-company-retailers/$ for CHATGPT-User
🤖 AI Added Allow: /es-la/blog/in-good-company-retailers/$ for Claude-SearchBot
🤖 AI Added Allow: /es-la/blog/in-good-company-retailers/$ for OAI-SearchBot
🤖 AI Added Allow: /es-la/blog/in-good-company-retailers/$ for PerplexityBot

view diff → snapshot

01.AI 01.ai modified +4 −8 4mo ago

Added rules for user-agent ‘*’
Added sitemap https://www.lingyiwanwu.com/sitemap.xml
Removed sitemap http://www.01.ai/sitemap.xml

view diff → snapshot

Glencore glencore.com modified +5 −5 4mo ago

Formatting/comment-only change (no semantic difference)

view diff → snapshot

IQVIA Holdings iqvia.com modified +2 −2 4mo ago

Added sitemap http://127.0.0.1/image-sitemap.xml
Added sitemap http://127.0.0.1/page-sitemap.xml
Removed sitemap http://www.iqvia.com/image-sitemap.xml
Removed sitemap http://www.iqvia.com/page-sitemap.xml

view diff → snapshot

Taobao taobao.com modified +1 −0 4mo ago

Added Allow: /$ for *

view diff → snapshot

Bank Central Asia bca.co.id modified +1 −1 4mo ago

Added sitemap https://www.bca.co.id/sitemap.xml
Removed sitemap http://www.bca.co.id/sitemap.xml

view diff → snapshot

WordPress wordpress.com modified +1 −1 4mo ago

Formatting/comment-only change (no semantic difference)

view diff → snapshot

Toronto Star thestar.com modified +14 −14 4mo ago

Formatting/comment-only change (no semantic difference)

view diff → snapshot

Etsy etsy.com modified +1 −1 4mo ago

Formatting/comment-only change (no semantic difference)

view diff → snapshot

IQVIA Holdings iqvia.com modified +2 −2 4mo ago

Added sitemap http://www.iqvia.com/image-sitemap.xml
Added sitemap http://www.iqvia.com/page-sitemap.xml
Removed sitemap http://127.0.0.1/image-sitemap.xml
Removed sitemap http://127.0.0.1/page-sitemap.xml

view diff → snapshot

KLA kla.com modified +1 −0 4mo ago

Formatting/comment-only change (no semantic difference)

view diff → snapshot

Toronto Star thestar.com modified +15 −15 4mo ago

Formatting/comment-only change (no semantic difference)

view diff → snapshot

The Independent independent.co.uk modified +2 −1 4mo ago

Formatting/comment-only change (no semantic difference)

view diff → snapshot

Ukraine (KMU) kmu.gov.ua modified +2 −2 4mo ago

Added Disallow: /npas/ for *
Added Disallow: /npasearch* for *

view diff → snapshot

IQVIA Holdings iqvia.com modified +2 −2 4mo ago

Added sitemap http://127.0.0.1/image-sitemap.xml
Added sitemap http://127.0.0.1/page-sitemap.xml
Removed sitemap http://www.iqvia.com/image-sitemap.xml
Removed sitemap http://www.iqvia.com/page-sitemap.xml

view diff → snapshot

Toronto Star thestar.com modified +14 −14 4mo ago

Formatting/comment-only change (no semantic difference)

view diff → snapshot

The Independent independent.co.uk modified +1 −2 4mo ago

Formatting/comment-only change (no semantic difference)

view diff → snapshot

Ukraine (KMU) kmu.gov.ua modified +2 −0 4mo ago

Added Disallow: /themes/ for *

view diff → snapshot

Pinterest pinterest.com modified +7 −7 4mo ago

Formatting/comment-only change (no semantic difference)

view diff → snapshot

Adidas adidas.com modified +1 −1 4mo ago

Formatting/comment-only change (no semantic difference)

view diff → snapshot

IQVIA Holdings iqvia.com modified +2 −2 4mo ago

Added sitemap http://www.iqvia.com/image-sitemap.xml
Added sitemap http://www.iqvia.com/page-sitemap.xml
Removed sitemap http://127.0.0.1/image-sitemap.xml
Removed sitemap http://127.0.0.1/page-sitemap.xml

view diff → snapshot

WordPress wordpress.com modified +1 −1 4mo ago

Formatting/comment-only change (no semantic difference)

view diff → snapshot

Toronto Star thestar.com modified +13 −13 4mo ago

Formatting/comment-only change (no semantic difference)

view diff → snapshot

Ukraine (KMU) kmu.gov.ua modified +1 −0 4mo ago

Formatting/comment-only change (no semantic difference)

view diff → snapshot

IQVIA Holdings iqvia.com modified +2 −2 4mo ago

Added sitemap http://127.0.0.1/image-sitemap.xml
Added sitemap http://127.0.0.1/page-sitemap.xml
Removed sitemap http://www.iqvia.com/image-sitemap.xml
Removed sitemap http://www.iqvia.com/page-sitemap.xml

view diff → snapshot

Amgen amgen.com modified +2 −0 4mo ago

Formatting/comment-only change (no semantic difference)

view diff → snapshot

WordPress wordpress.com modified +1 −1 4mo ago

Formatting/comment-only change (no semantic difference)

view diff → snapshot

Toronto Star thestar.com modified +19 −19 4mo ago

Formatting/comment-only change (no semantic difference)

view diff → snapshot

The Independent independent.co.uk modified +2 −1 4mo ago

Formatting/comment-only change (no semantic difference)

view diff → snapshot

KLA kla.com modified +1 −0 4mo ago

Formatting/comment-only change (no semantic difference)

view diff → snapshot

The Pulse