PLI Labs
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- DeepSeek-V4.1-Flash benchmarked on dual DGX Spark hardware
Nick Mermiges of PLI Labs benchmarked DeepSeek-V4.1-Flash-1017 at 2.75 bpw with EXL3 and vLLM across two NVIDIA DGX Spark systems. An EPYC system with two RTX 3090s handled Engram tables and speculative drafting. In the author's tests, reported as medians of three runs, prefill reached 2,618 tokens per second with a 256K prompt, while structured JSON output reached 322 tokens per second across four streams. The report published the code, launch scripts, benchmark tool and raw results, while noting lower prose throughput and slower decoding than some cited deployments. Planned 1M-token context, llama-benchy, BFCL and head-to-head KLD tests were not yet available, and the prefix-cache code was still pending publication.
r/LocalLLaMA · 🔥 4
Experience and discussion from the community
Share my PLI Labs experienceAsk about PLI Labs
Nobody has shared their experience with PLI Labs yet.