Reinforcement Learning Teachers of Test Time Scaling
Research paper
Sakana AI introduces Reinforcement-Learned Teachers (RLTs), a new method for training teacher models to generate explanations for student models by learning to teach rather than solve problems.
The teacher is rewarded based on the student's understanding.
Small 7B parameter RLTs outperform much larger models like 
DeepSeek R1 (671B) in teaching reasoning skills.
The code, paper, and open models are released.
