From the source
Hugging Face released a technical guide on integrating multiple quantization backends (bitsandbytes, GGUF, torchao, Quanto, FP8) into Diffusers to reduce memory usage of diffusion models like Flux, with benchmark data.
From the source
this post explores the diverse quantization backends integrated directly into Hugging Face Diffusers. We'll examine how bitsandbytes, GGUF, torchao, Quanto and native FP8 support make large and powerful models more accessible, demonstrating their use with Flux.
huggingface.co
