Nemotron-3.5-Lightning
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- NVIDIA SEED Cuts Prefill Work and Compresses Hybrid LLM State
NVIDIA researchers proposed SEED, a method that uses shallower layers and lightweight emitters to write memories needed for later generation while retaining full-depth computation during decoding. On Qwen3.8-Flash-Next, parameter-dependent prefill computation fell about 25%, from 12.1 to 9.1 GFLOP per non-final input token. SEED also stores recurrent state in a compressed representation, reducing Qwen3.8-Flash-Next's per-request state from 113.2 MB to 29.2 MB immediately after compression and averaging 43.4 MB over the compression cycle. The report describes tests on five hybrid models and an arXiv preprint. In GB300 GPU and SGLang tests replaying coding-agent sessions, NVIDIA reported 16%–42% higher peak throughput per GPU; gains varied by deployment and workload.
机器之心 · 🔥 0
Experience and discussion from the community
Share my Nemotron-3.5-Lightning experienceAsk about Nemotron-3.5-Lightning
Nobody has shared their experience with Nemotron-3.5-Lightning yet.