From the source
The Direct Preference Optimization (DPO) method available in the TRL library and demonstrates how to fine-tune the Llama v2 7B model on the stack-exchange preference dataset.
From the source
This blog-post introduces the Direct Preference Optimization (DPO) method which is now available in the TRL library and shows how one can fine tune the recent Llama v2 7B-parameter model on the stack-exchange preference dataset
huggingface.co
