Parameter-Efficient Fine-Tuning using 🤗 PEFT

Hugging Face introduces the PEFT library for parameter-efficient fine-tuning of billion-scale models on low-resource hardware.

It supports methods like LoRA, Prefix Tuning, Prompt Tuning, and P-Tuning, and is integrated with Transformers and Accelerate, enabling fine-tuning on consumer hardware with tiny checkpoints.