From the source
From the source
Data from Vercel shows AI crawler traffic patterns and limitations
Vercel and MERJ analyzed AI crawler traffic across Vercel's network, finding that GPTBot generated 569 million requests and Claude 370 million in the past month, together about 20% of Googlebot's 4.5 billion requests.
None of the major AI crawlers (OpenAI,
Anthropic,
Meta,
ByteDance, Perplexity) currently render JavaScript, while Google's Gemini and AppleBot do.
ChatGPT spends 34.82% of its fetches on 404 pages and Claude 34.16%, compared to Googlebot's 8.22%.
From the source
Our analysis shows a clear divide in JavaScript rendering capabilities among AI crawlers. ... The results consistently show that none of the major AI crawlers currently render JavaScript.
vercel.com
