Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Tencent open-sources DSpine, a parallel drafter for speculative decoding

AI summary

Tencent published inference code and open weights for DSpine as tencent/Qwen3-8B-DSpine-b16 on Hugging Face under Apache 2.0. DSpine is a parallel drafter for speculative decoding: at every draft layer each position receives the predicted feature of its predecessor, so the causal chain unfolds over network depth while all positions are still drafted in parallel. The model card says the paper was released on arXiv in September 2026 and the inference code in October 2026, with training code and a Qwen3.8-27B version still on the roadmap. In the team's comparison on Qwen3-8B against DSpark, DFlash2, DFlash and Domino (all retrained with the same configuration on Open-PerfectBlend), DSpine reports the best average acceptance length, 7.83 at T=0 and 6.98 at T=1, though these figures are self-reported by the releasing team.

In-depth insight

Draft efficiency in speculative decoding directly affects LLM inference latency, so a parallel-drafting scheme that holds up in third-party reproduction could reduce decoding overhead in deployment.

TencentDSpineQwen3-8B

Original · 2 min readRead the original
Group chat

No comments yet. Start the conversation.