Anthropic bot crawlers feast on web content and give little back, a new ranking shows

businessinsider.com/anthropic-bot-crawlers-feast-on-web-give-little-back-ranking-2025-9

A giant mechanical spider walks along the waterfront in Yokohama, south of Tokyo.
REUTERS/Issei Kato
AI companies such as Anthropic are heavily crawling websites, offering little referral traffic.
Historically, tech firms exchanged data access for web traffic, but AI disrupts this…

This story appeared on businessinsider.com, 2025-09-12 09:00:02.
The Entire Business World on a Single Page. Free to Use →