From the source
OpenAI has signed agreements with four independent assessors —
Apollo Research, METR, Transluce and Goodfire — for a first phase of embedded assessments, giving outside experts deep access to its internal models and systems.
- The company says the arrangement is meant to let independent reporting give people a clearer view of how labs evaluate and manage risk as AI capabilities advance.
- Embedded assessments grant assessors some of the same internal resources OpenAI researchers use, including model checkpoints, source code, training and evaluation data, monitoring systems, technical documentation, and discussions with the responsible researchers and engineers.
- The initial work focuses on alignment and safeguards for models during training and internal use, complementing OpenAI's safety cases, and builds on a recent pilot assessment of its internal monitoring systems and an investigation of the
Hugging Face incident.
Apollo Research will assess whether models could covertly work against their developers' intentions and whether safeguards would detect such behavior, testing four claims in two stages.
- METR is to assess misaligned behavior in what OpenAI calls its largest reinforcement learning run to date, and the two have preliminarily agreed to a broader monitor assessment pending agreement on scope.
- Transluce will examine the quality and coverage of OpenAI's post-training alignment evaluations, with a follow-on assessment of about eight weeks planned for early 2027.
- OpenAI says the efforts support commitments under the White House Accord on Super Intelligence, where it agreed to independent assessments of its safety controls.




