DABStep: Data Agent Benchmark for Multi-step Reasoning

Hugging Face and Adyen introduce DABStep, a benchmark of over 450 real-world data analysis tasks for evaluating LLM agents. Current models achieve only 16% accuracy.

From the source
Adyen and Hugging Face built the Data Agent Benchmark for Multi-step Reasoning (DABstep) together. DABstep consists of over 450 data analysis tasks designed to evaluate the capabilities of state-of-the-art LLMs and AI agents. Our findings reveal that DABstep presents a significant challenge for current AI models, with the most capable reasoning-based agents achieving only 16% accuracy, highlighting significant progress to be made in the field.
huggingface.co

Visit source ↗huggingface.co

Announced: 04 Feb 2025 00:00 UTC
Detected: 03 Aug 2026 21:12 UTC (+545d after)

Other stories

Hugging Face · 28 AugThe Open ASR Leaderboard Adds Its First Global South LanguageCapability change

Google Research · 27 AugPlanetary prediction engine: Automating global models via Earth AIResearch paper

OpenAI · 27 AugBetter answers, broader thinking: What students gain from ChatGPT and critical-thinking trainingResearch paper

LG AI Research · 27 Aug

[ACL 2026] ReSQL: A Self-Improving Text-to-SQL Framework through Retrieval-Augmented Error Reasoning

Research paper

Amazon · 31 AugAWS recognized as a Leader in The Forrester Wave: AI Infrastructure Solutions, Q4 2025Company news

Amazon · 31 AugManage agents, tools and skills at scale with AWS Agent Registry