deepseek-recipe

Headlines · 2

1. Oct 20
   DeepSeek Open-Sources the DeepInfer Production Inference Framework

   DeepSeek has open-sourced DeepInfer, the inference framework used for high-throughput, low-latency production serving of DeepSeek-V4.1-Flash. The release includes distributed inference, speculative decoding, SWA Bounded Replay, structured output and the deepseek-recipe component for converting between API protocols and model tokens. DeepSeek said the system supports NVIDIA SM100 Blackwell GPUs and Huawei Ascend 950 NPUs; older NVIDIA architectures were not listed. According to DeepSeek, one cluster processes 155 trillion tokens per day and generates $38 in revenue per GPU-hour at off-peak pricing. The release does not include all of DeepSeek’s online infrastructure, as KVCache management and cross-replica load-balancing code were not fully open because of their coupling with internal systems.

   InfoQ 中文 AI&大模型 · 🔥 0
2. Oct 12
   DeepSeek-V4.1-Flash: 552B multimodal MoE with 1M context

   DeepSeek published DeepSeek-V4.1-Flash on Hugging Face, a natively multimodal mixture-of-experts model with 552B backbone parameters and up to a 1M-token context, built on a Causal Encoder-Decoder design (20 encoder plus 20 decoder layers) that activates only 8B parameters per token in prefill and 16B in decode. It combines Compressed Sparse Attention 2 with FP4 main-KV caching (E2M1 format, one E4M3 scale per 16 channels) to cut the global KV cache to about 890 bytes per token — roughly a quarter of DeepSeek-V4-Flash — and offers a continuously controllable reasoning effort from 1 to 100, with weights under the MIT license. The vendor's own model card reports Terminal-Bench 2.1 at 90.6 (versus Opus-5.0 at 89.1 and GPT-5.6 Sol at 88.8), DeepSWE v1.1 at 74.2 and a Codeforces rating of 3471, but these figures are self-reported and not independently verified; the release also omits a Jinja chat template and ships a deepseek-recipe toolkit for prompt encoding instead.

   DeepSeek · Hugging Face · 🔥 0

Experience and discussion from the community

Share my deepseek-recipe experienceAsk about deepseek-recipe