Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

DeepSeek-V4.1-Flash: 552B multimodal MoE with 1M context

AI summary

DeepSeek published DeepSeek-V4.1-Flash on Hugging Face, a natively multimodal mixture-of-experts model with 552B backbone parameters and up to a 1M-token context, built on a Causal Encoder-Decoder design (20 encoder plus 20 decoder layers) that activates only 8B parameters per token in prefill and 16B in decode. It combines Compressed Sparse Attention 2 with FP4 main-KV caching (E2M1 format, one E4M3 scale per 16 channels) to cut the global KV cache to about 890 bytes per token — roughly a quarter of DeepSeek-V4-Flash — and offers a continuously controllable reasoning effort from 1 to 100, with weights under the MIT license. The vendor's own model card reports Terminal-Bench 2.1 at 90.6 (versus Opus-5.0 at 89.1 and GPT-5.6 Sol at 88.8), DeepSWE v1.1 at 74.2 and a Codeforces rating of 3471, but these figures are self-reported and not independently verified; the release also omits a Jinja chat template and ships a deepseek-recipe toolkit for prompt encoding instead.

In-depth insight

If the self-reported agentic scores and KV-cache savings hold up, serving long-context agent workloads could get materially cheaper.

DeepSeekDeepSeek-V4.1-FlashDeepSeek-V4-Flash

Original · 6 min readRead the original
Group chat

No comments yet. Start the conversation.