Inside VAKRA: Reasoning, Tool Use, and Failure Modes of Agents
Research paper
Hugging Face and IBM Research published a blog post introducing VAKRA, a tool-grounded, executable benchmark for evaluating AI agents' reasoning and tool use in enterprise environments.
The post describes the benchmark's four tasks, dataset details, and analysis of failure modes observed on different tasks.
