From the source
Lead story
Top stories
Models & availability
Latest
Lead story
Top stories
Models & availability
Latest
From the source
Anthropic partners with Accenture on embedded AI evaluation
Anthropic is partnering with Accenture's Faculty division on independent embedded evaluation of frontier AI models.
Embedded evaluators will work inside Anthropic with employee-level access to assess model development, safety commitments, and safeguards.
Anthropic and Accenture each expect to invest at least $1 billion in building evaluation capacity over the next five years, with Anthropic directly funding Accenture's work and also piloting embedded evaluation with nonprofit evaluators including METR.
From the source
Unlike today's external evaluators, embedded evaluators will work inside AI companies, with access comparable to an employee's. That access allows them to watch models take shape in training, follow the decisions that govern how those models are built and deployed, and speak directly to employees.
anthropic.com
Reported by