From the source
From the source
Cloudflare measures how consistently Verified bots respect site preferences.
Cloudflare introduced a system to evaluate and report when Verified bot behavior deviates from its rules, measuring how consistently bots respect site preferences such as robots.txt directives and HTTP 429 responses.
The observations will be used to create an explainable trust band for each bot, and Cloudflare plans to eventually share these scores publicly on Radar and make the system available to all customers.
From the source
We developed a system to measure how often a crawler respects site preferences. These observations will translate to an explainable trust band: a range showing how consistently a bot respects site preferences and which observed behaviors informed that assessment, rather than a permanent judgment about a bot or its operator.
blog.cloudflare.com
