FLUX is fast and it's open source

Replicate has optimized FLUX.1 schnell and FLUX.1 dev models to run significantly faster, and has open-sourced the optimization code.

The optimizations include using torch.compile, fast CuDNN attention kernels, and a new synchronous HTTP API.

Users can disable optimizations via the go_fast input.