Preference Optimization for Vision Language Models

Hugging Face announces that the TRL library now supports direct preference optimization (DPO) for vision language models (VLMs), including Idefics2-8b, Llava 1.5, and PaliGemma.

From the source
We are excited to announce that the TRL library now supports direct preference optimization (DPO) for VLMs.
huggingface.co

Visit source ↗huggingface.co

Announced: 10 Jul 2024 00:00 UTC
Detected: 03 Aug 2026 21:12 UTC (+754d after)

Other stories

Hugging Face · 28 AugThe Open ASR Leaderboard Adds Its First Global South LanguageCapability change

Amazon · 31 AugConnect an AgentCore Runtime hosted MCP server to Amazon QuickCapability change

Amazon · 31 AugAWS recognized as a Leader in The Forrester Wave: AI Infrastructure Solutions, Q4 2025Company news

Amazon · 31 Aug

Manage agents, tools and skills at scale with AWS Agent Registry

Amazon · 31 AugBuild observable enterprise agentic retrieval using Managed Amazon Bedrock Knowledge Base with AWS CloudFormationInfrastructure

Amazon · 31 AugBuild multi-tenant agentic chat applications on enterprise data with Amazon Bedrock Managed Knowledge Base