Amazon· Bedrock / NovaCapability change

Evaluate any agent framework with Amazon Bedrock AgentCore Evaluations

Amazon Bedrock AgentCore Evaluations is a new evaluation service that uses OpenTelemetry to score any agent framework (LangGraph, LlamaIndex, OpenAI Agents SDK, Google ADK, Claude Agent SDK, Strands Agents) running on Amazon Bedrock AgentCore runtime, without requiring framework-specific integration. It reads three span roles (invoke agent, inference, execute tool) to reconstruct sessions and apply evaluators such as GoalSuccessRate, Correctness, Helpfulness, and custom LLM-as-a-judge. The service bridges both OpenTelemetry GenAI conventions and OpenInference specifications.

From the source

Amazon Bedrock AgentCore evaluations solves this fragmentation by decoupling evaluation from the framework choice.

aws.amazon.com

Announced

26 Aug 2026 19:13 UTC