# Hugging Face — Fine-Tuning Gemma Models in Hugging Face

- Company: Hugging Face (huggingface.co)
- Announced: 2024-02-23T00:00:00+00:00
- Category: developer-tool-release
- Subject: Platform
- Open weights: yes
- Models affected: Gemma
- Source: https://huggingface.co/blog/gemma-peft
- Record: https://forck.live/items/1935-fine-tuning-gemma-models-in-hugging-face

Hugging Face announces support for fine-tuning Google DeepMind's Gemma models using Parameter Efficient Fine-Tuning (PEFT) techniques, specifically LoRA and QLoRA, with the Hugging Face Transformers and PEFT libraries on GPUs and Cloud TPUs.

## Evidence

Verbatim from https://huggingface.co/blog/gemma-peft:

> In this post we will briefly review how you can do Parameter Efficient FineTuning (PEFT) for Gemma models, using the Hugging Face Transformers and PEFT libraries on GPUs and Cloud TPUs for anyone who wants to fine-tune Gemma models on their own dataset.

---

Record: https://forck.live/items/1935-fine-tuning-gemma-models-in-hugging-face
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md