From the source
Lead story
Ask your AI
Top stories
Models & availability
Latest
Amazon· Bedrock / NovaEvaluate skill-equipped agents with Strands Evals and Amazon Bedrock AgentCore
New evaluators for skill-equipped agents in Bedrock
Amazon Bedrock AgentCore Evaluations and Strands Evals SDK add skill-focused evaluators to measure agent behavior with modular skills.
Skill Selection Accuracy determines whether invoked skills are appropriate for tasks, Skill Instruction Following rates how fully agents follow skill instructions on a five-level scale, and Skill Invoked provides deterministic checks for skill loading.
From the source
To make these failures measurable, Strands Evals SDK and Amazon Bedrock AgentCore Evaluations, a capability of Amazon Bedrock AgentCore, add skill-focused evaluators: Skill Selection Accuracy determines whether each invoked skill was an appropriate choice for the task. It returns a binary result for each invoked skill. Skill Instruction Following determines how fully the agent followed an invoked skill's instructions. It returns a five-level rating grounded in evidence for each prescribed step.
aws.amazon.com
Other stories
Amazon · 2 OctSweep thousands of leases for compliance using Amazon Quick and the Adjudicated Query patternAmazon · 2 OctAdd secure Web Search to Claude Desktop with Amazon Bedrock AgentCoreAmazon · 2 OctFine-tune a search agent with multi-turn RL on Amazon SageMaker AIAmazon · 1 OctServe live, governed data in AI-built apps with Amazon Quick