From the source
ReasoningBank is a novel agent memory framework that uses successful and failed experiences to distill generalizable reasoning strategies, enabling agents to learn continuously after deployment.
It also introduces memory-aware test-time scaling (MaTTS) to leverage exploration for better learning.