Gaia2 and ARE: Empowering the community to study agents

Hugging Face introduces Gaia2, a follow-up to the GAIA benchmark for evaluating AI agents, and the open Meta Agents Research Environments (ARE) framework for running, debugging, and evaluating agents.

Gaia2 includes tasks such as execution, search, ambiguity handling, adaptability, temporal reasoning, agent-to-agent collaboration, and noise tolerance.

The dataset is released under CC by 4.0, and ARE under MIT license.

Results comparing various models are provided.