From the source
Hugging Face reduced LoRA inference warm-up time from 25s to 3s by dynamically swapping adapters while keeping the base model warm, cutting response time from 35s to 13s and using fewer GPUs.
From the source
We swap the Stable Diffusion LoRA adapters per user request, while keeping the base model warm allowing fast LoRA inference across multiple users.
huggingface.co
