From the source
Baseten optimized 80+ kernels and bottlenecks for
DeepSeek V4.1 Flash 1017 to produce a Fast variant, which it says reaches 991 output tokens/s on Artificial Analysis and the lowest time per task on the Pareto frontier.
- The company says flash models now dominate the low-cost Pareto frontier, and it cites DeepSeek V4.1 Flash 1017 at native precision as a 552B-parameter MoE with 8B active during prefill and 16B active during decode that scores 32 on the new Artificial Analysis V5.0 Index, the same as GLM-5.3, at roughly a third the cost and 4x the speed of the larger model.
- Baseten describes three hardware-level techniques behind the work: kernel fusion, Programmatic Dependent Launch and host loop minimization, and says it plans to release open-source work around each soon.
- One example is an improved fused router kernel that decreases decode time by 2.7ms, and the team says it improved the open-source megakernel for mHC in DeepInfer for lower latency at batch size 1 and 30% more speed.
- In Cline's testing, the new DeepSeek flash model outperformed 5.6 Sol on Terminal-Bench 4.0 while being about 17x cheaper, according to the post.





