Evaluate any agent framework with Amazon Bedrock AgentCore Evaluations

Amazon Bedrock AgentCore Evaluations is a new evaluation service that uses OpenTelemetry to score any agent framework (LangGraph, LlamaIndex, OpenAI Agents SDK, Google ADK, Claude Agent SDK, Strands Agents) running on Amazon Bedrock AgentCore runtime, without requiring framework-specific integration.

It reads three span roles (invoke agent, inference, execute tool) to reconstruct sessions and apply evaluators such as GoalSuccessRate, Correctness, Helpfulness, and custom LLM-as-a-judge.

The service bridges both OpenTelemetry GenAI conventions and OpenInference specifications.