# Hugging Face — Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

- Company: Hugging Face (huggingface.co)
- Announced: 2023-03-09
- Category: developer-tool-release
- Coverage: not counted
- Announcement: no
- Group: routine
- Source: https://huggingface.co/blog/trl-peft
- Record: https://forck.live/items/2086-fine-tuning-20b-llms-with-rlhf-on-a-24gb-consumer-gpu
- Subject: Platform

Hugging Face announces the official integration of TRL with PEFT, enabling fine-tuning of large language models (up to 20B parameters) with RLHF on a single 24GB consumer GPU using adapters and 8-bit quantization.

## Evidence

Verbatim from https://huggingface.co/blog/trl-peft:

> We are excited to officially release the integration of trl with peft to make Large Language Model (LLM) fine-tuning with Reinforcement Learning more accessible to anyone!

---

Record: https://forck.live/items/2086-fine-tuning-20b-llms-with-rlhf-on-a-24gb-consumer-gpu
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md