D3D enables asynchronous speculative decoding with diffusion drafting
The arXiv paper introduces D3D, a standalone diffusion drafter that removes the dependency between successive drafting rounds by combining blockwise denoising with auxiliary autoregressive supervision. Its independence from target-model hidden states allows successor blocks to be drafted while verification runs, while progressive layer pruning reduces packed-drafting cost. The authors report average decoding speedups of 5.00× and 5.71× across seven benchmarks with Qwen3-8B and Qwen3-32B targets, plus 7.48× on GSM8K with Qwen3-32B; these figures remain author-reported.
D3D’s decoupled design directly addresses a sequencing bottleneck in diffusion-based speculative decoding, and the accompanying r/LocalLLaMA share lists six public Qwen3-derived draft checkpoints, pruning variants, training corpora, and code.
Computer Science > Artificial Intelligence
arXiv:2611.06425 (cs)
[Submitted on 4 Nov 2026]
Title:D3D: Decoupled Diffusion Drafting for Asynchronous Speculative Decoding
Authors:Baoyou Chen, Ruiqiao Mei, Guancong Lin, Tao Song, Weihao Yuan, Qun Liu, Siyu Zhu
View a PDF of the paper titled D3D: Decoupled Diffusion Drafting for Asynchronous Speculative Decoding, by Baoyou Chen and 6 other authors