EAGLE-3
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 5
- NarrowSpec enables narrower speculative-decoding drafts
A paper submitted to arXiv on November 18, 2026 proposes that speculative-decoding draft models need not have the same hidden width as their target models. The authors report that DFlash and EAGLE-3 drafts using half or one-quarter of the target width largely preserve token acceptance. In tests with Qwen3-8B (NVFP4) and GPT-OSS-20B (MXFP4) running in SGLang, the authors report end-to-end decoding speedups of 1.06–1.12x on an NVIDIA B200 and 1.13–1.44x on a DGX Spark (GB10) at batch size 1 and temperature 0.
Hugging Face · Papers · 🔥 0 - CPU Interactive Demo Covers Kimi K3 MTP and EAGLE-3
RossiLH’s Juejin article presents a 13-tab interactive demonstration of MTP and EAGLE-3 components associated with Kimi K3. It runs entirely on CPU and reuses source-code operators to cover token-offset alignment, joint loss, feature fusion, theoretical and measured speedup, lossless verification, LK loss, draft generation, KDA and MLA cache rollback, parameter counts, and loss-weight sweeps. The author says the project uses reduced versions of original model components where possible and approximate components when open-source versions are unavailable. It also includes verification tests for formulas, drafting, recomputation, rollback, and cache restoration.
掘金 · 人工智能 · 🔥 0 - A Lightweight Kimi K3 Replication of MTP and EAGLE-3
A Juejin AI technical article presents the second installment of a lightweight Kimi K3 project implementing multi-token prediction and EAGLE-3. The code covers an MTP side head, offset-aligned prediction, [0 0 I] feature fusion, an acceptance-oriented loss, autoregressive drafting, verification, and cache rollback. In the author’s small CPU experiment, lossless speculative decoding recorded a 0.1296 acceptance rate and 1.389 tokens per forward, versus a 1.0 baseline.
掘金 · 人工智能 · 🔥 0 - CPU-Only Educational Reproduction of Kimi K3 MTP and EAGLE-3
RossiLH presented a CPU-only educational implementation inspired by Kimi K3’s multi-token prediction and EAGLE-3 draft-modeling approach. It includes an MTP layer, EAGLE-3 feature fusion, and speculative-decoding verification, with runnable Gradio demos for the main components. The author describes the project as an attempt and learning process. Its components are generally scaled down, and approximate substitutes are used where open versions of the original components are unavailable.
掘金 · 人工智能 · 🔥 0 - MMFlash targets faster speculative decoding for vision-language models
The MMFlash authors released code and draft-model artifacts for speeding up speculative decoding in vision-language models, with support for Qwen3.5-4B, Qwen3.5-9B, Qwen3.8-27B and Gemma 4 E4B-it targets. They report that MMFlash adaptively prioritizes visually dependent tokens and uses sparse attention for long-video inputs, achieving lossless decoding speedups of up to 3.58× across multimodal benchmarks. These benchmark results come from the authors and have not been independently validated by the Reddit report.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my EAGLE-3 experienceAsk about EAGLE-3
Nobody has shared their experience with EAGLE-3 yet.