From the source
From the source
Sakana AI announces a research paper at ICML 2026 that bridges parametric and nonparametric black-box optimization methods, showing they are variations of a single update equation.
The paper introduces two new hybrid optimizers, AdaPol and SchedPol, and demonstrates their application in merging large language models efficiently.
From the source
We are pleased to present our research at ICML 2026, “Bridging Spherical Black-Box Optimizers”. ... By bridging this theoretical gap, we can now engineer custom hybrid optimizers for specific tasks. ... deploying our newly developed hybrid optimizers, AdaPol and SchedPol, we successfully navigated this issue.
sakana.ai