From the source
An optimization recipe for LoRA inference on the Flux.1-Dev model using Diffusers and PEFT, achieving approximately 2.3x speedup through Flash Attention 3, torch.compile, FP8 quantization, and hotswapping without recompilation.
From the source
From the source

An optimization recipe for LoRA inference on the Flux.1-Dev model using Diffusers and PEFT, achieving approximately 2.3x speedup through Flash Attention 3, torch.compile, FP8 quantization, and hotswapping without recompilation.
From the source
2.23×
huggingface.co