From the source
Lead story
Ask your AI
Top stories
Models & availability
Latest
Amazon· Bedrock / NovaAgent Evaluation Metric for multi-turn conversations
New metric decomposes multi-turn agent quality into turn-level truthfulness and completeness scores.
Amazon introduces the Agent Evaluation Metric (AEM), a decomposable, turn-level metric for measuring agent quality in multi-turn conversations.
The first dimension implemented is correctness, which is broken into truthfulness and completeness sub-metrics.
AEM is designed to isolate root causes of errors from downstream effects.
From the source
This post introduces the Agent Evaluation Metric (AEM), a decomposable, turn-level way to measure agent quality.
aws.amazon.com
Other stories
Amazon · 2 OctSweep thousands of leases for compliance using Amazon Quick and the Adjudicated Query patternAmazon · 2 OctAdd secure Web Search to Claude Desktop with Amazon Bedrock AgentCoreAmazon · 2 OctFine-tune a search agent with multi-turn RL on Amazon SageMaker AI