DeepSeek-V4.1-Flash-1015

Headlines · 1

1. 16h
   DeepSeek-V4.1-Flash benchmarked on dual DGX Spark hardware

   Nick Mermiges of PLI Labs benchmarked DeepSeek-V4.1-Flash-1017 at 2.75 bpw with EXL3 and vLLM across two NVIDIA DGX Spark systems. An EPYC system with two RTX 3090s handled Engram tables and speculative drafting. In the author's tests, reported as medians of three runs, prefill reached 2,618 tokens per second with a 256K prompt, while structured JSON output reached 322 tokens per second across four streams. The report published the code, launch scripts, benchmark tool and raw results, while noting lower prose throughput and slower decoding than some cited deployments. Planned 1M-token context, llama-benchy, BFCL and head-to-head KLD tests were not yet available, and the prefix-cache code was still pending publication.

   r/LocalLLaMA · 🔥 4

Experience and discussion from the community

Share my DeepSeek-V4.1-Flash-1015 experienceAsk about DeepSeek-V4.1-Flash-1015