From the source
This blog post reproduces OpenAI's 2019 RLHF codebase and provides implementation details for RLHF with PPO, including matching learning curves and technical deep dives.
The N Implementation Details of RLHF with PPO
From the source
In our quest to research more on RLHF, this blog post attempts to do a reproduction of OpenAI’s 2019 original RLHF codebase at openai/lm-human-preferences.
huggingface.co
