Cloudflare and OpenAI: making AI discovery better for everyone

Cloudflare and OpenAI report early results from a research pilot that uses Cloudflare's network signals to help OpenAI's search crawler discover new web pages for ChatGPT.

The pilot, involving about 1% of Cloudflare's network, has enabled OpenAI to index hundreds of millions of previously unknown pages.

The partners are also testing signals to identify harmful pages and reduce unnecessary crawling.