Vision Language Model Alignment in TRL ⚡️

Hugging Face announces new alignment methods for Vision Language Models in TRL: Mixed Preference Optimization (MPO), Group Relative Policy Optimization (GRPO), Group Sequence Policy Optimization (GSPO), plus extensions for RLOO and Online DPO, and native SFT support for VLMs.

From the source
Here’s what’s new in TRL: Mixed Preference Optimization (MPO) Group Relative Policy Optimization (GRPO) Group Sequence Policy Optimization (GSPO) (a variant of GRPO)
huggingface.co

Visit source ↗huggingface.co

Announced: 07 Aug 2025 00:00 UTC
Detected: 03 Aug 2026 21:12 UTC (+361d after)

Other stories

Hugging Face · 28 AugThe Open ASR Leaderboard Adds Its First Global South LanguageCapability change

xAI · 29 AugGrok Bot now works with XCapability change

GitHub · 28 AugGitHub Copilot in Visual Studio — August update

GitHub · 28 AugGitHub Copilot weekly releases — August 24Capability change

Amazon · 28 AugBatch write and discover records in Amazon SageMaker Feature Store

API release

Perplexity · 28 AugGLM 5.3API release