GSPO: Towards Scalable Reinforcement Learning for Language Models

Alibaba proposes the Group Sequence Policy Optimization (GSPO) algorithm to address instability and model collapse issues in existing reinforcement learning algorithms for language models, aiming to enable scalable RL training.