Deepseek open-sources the inference engine that powers its fastest and cheapest AI model

Deepseek has open-sourced DeepInfer, the internal inference framework that serves its V4.1-Flash model, under the Apache License 2.0.

• Inference is how a trained model handles requests and generates responses, and DeepInfer is the serving software that lets V4.1-Flash answer quickly at scale.
• The framework builds on vLLM with optimized compute kernels, distributed processing across multiple chips, and faster text generation techniques.
• Deepseek says code for future models will also ship as open source, and it is releasing deepseek-recipe, which replicates the token processing of the official Deepseek API so self-hosted setups behave the same way.
• The company said on X that the goal is "to help the community lower compute costs, reduce energy use, and make AI more affordable."
• The release also adds pricing pressure on Western providers such as OpenAI and Anthropic, and the report notes the US-China AI race could make the move politically motivated.