# Hugging Face — The N Implementation Details of RLHF with PPO

- Company: Hugging Face (huggingface.co)
- Announced: 2023-10-24
- Category: not stated
- Coverage: not counted
- Announcement: no
- Group: routine
- Source: https://huggingface.co/blog/the_n_implementation_details_of_rlhf_with_ppo
- Record: https://forck.live/items/1981-the-n-implementation-details-of-rlhf-with-ppo
- Subject: Platform

This blog post reproduces OpenAI's 2019 RLHF codebase and provides implementation details for RLHF with PPO, including matching learning curves and technical deep dives.

## Evidence

Verbatim from https://huggingface.co/blog/the_n_implementation_details_of_rlhf_with_ppo:

> In our quest to research more on RLHF, this blog post attempts to do a reproduction of OpenAI’s 2019 original RLHF codebase at openai/lm-human-preferences.

---

Record: https://forck.live/items/1981-the-n-implementation-details-of-rlhf-with-ppo
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md