Lead story
Models & availability
Latest
Lead story
Models & availability
Latest
Hugging Face announces that its Quanto quantization toolkit can be used with Diffusers to reduce GPU memory consumption for Transformer-based diffusion pipelines, including PixArt-Sigma, Stable Diffusion 3, and Aura Flow, with minimal quality loss.
From the source
In this post, we show how to improve the memory efficiency of Transformer-based diffusion pipelines by leveraging Quanto's quantization utilities from the Diffusers library.
huggingface.co