From the source
Hugging Face announces the integration of Liger GRPO with TRL, achieving 40% memory reduction in GRPO training with no quality loss, along with FSDP and PEFT support.
From the source
Liger supercharges TRL’s Group Relative Policy Optimization (GRPO) Trainer by slashing memory usage by 40% with zero drop in model quality.
huggingface.co
