From the source
Hugging Face announces that the TRL library now supports direct preference optimization (DPO) for vision language models (VLMs), including Idefics2-8b, Llava 1.5, and PaliGemma.
From the source
We are excited to announce that the TRL library now supports direct preference optimization (DPO) for VLMs.
huggingface.co
