From the source
Sakana AI introduces ALE-Bench, a coding benchmark for hard optimization problems, and ALE-Agent, a coding agent that achieved 21st place among over 1,000 human participants in a live AtCoder Heuristic Competition.
Towards Automating Long-Horizon Algorithm Engineering for Hard Optimization Problems
Research paper
From the source
We introduce ALE-Bench, a coding benchmark inspired by hard optimization problems whose true optima are computationally out of reach (e.g., NP-hard). This benchmark enabled the development of our new coding agent, ALE-Agent, designed to tackle hard optimization problems. In May 2025, ALE-Agent achieved 21st out of 1,000 human participants in a live AtCoder Heuristic Competition (AHC), marking a turning point for AI discovery of solutions to hard optimization problems with important real world applications.
sakana.ai
