Direct Preference Optimization Beyond Chatbots

The post describes using Direct Preference Optimization (DPO) on OCR models to reduce text degeneration, using rejection pairs from the model's own failures. It reports an average reduction of 59.4% in degeneration rate across model families.

From the source
A second training stage - applied after supervised fine-tuning (SFT), on the same documents, using the same model - reduced text degeneration in every family tested. No exceptions. Average reduction: 59.4%.
huggingface.co

Visit source ↗huggingface.co

Announced: 03 Jun 2026 12:55 UTC
Detected: 03 Aug 2026 21:12 UTC (+61d after)

Other stories

Hugging Face · 28 AugThe Open ASR Leaderboard Adds Its First Global South LanguageCapability change

Google Research · 27 AugPlanetary prediction engine: Automating global models via Earth AIResearch paper

OpenAI · 27 AugBetter answers, broader thinking: What students gain from ChatGPT and critical-thinking trainingResearch paper

LG AI Research · 27 Aug

[ACL 2026] ReSQL: A Self-Improving Text-to-SQL Framework through Retrieval-Augmented Error Reasoning

Research paper

xAI · 29 AugGrok Bot now works with XCapability change

GitHub · 28 AugGitHub Copilot in Visual Studio — August update