From the source
Baseten's Base Labs argues that on-policy self-distillation (OPSD) is not worth further research effort, saying the method trades a noisy but well-aimed reward for a clean but biased one.
- OPSD has a student model learn from a teacher that is the same model given extra context, such as a ground-truth answer, so the teacher never has to check, backtrack or hedge.
- The authors say that dense per-token supervision mostly adds bias, and that this bias is worse than having more variance, especially in heavily trained models.
- They point to results where OPSD gains faded: with thinking enabled, average accuracy fell for all five thinking models compared with no thinking, and on held-out coding problems SDPO lost 2.5 points on Qwen3-8B and 9.9 on Olmo-3-7B-Instruct, while GRPO gained.
- One study cited found OPSD guides the student toward the teacher model averaged over hints rather than toward a teacher conditioned on success.
- The authors still allow that OPSD may remain useful in certain contexts.





