Alaya-DFlash2
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- AlayaNeW open-sources Alaya-DFlash2, claiming 3.41x GLM-5.3 decode speedup
AlayaNeW (九章云极) released and open-sourced Alaya-DFlash2, a speculative-decoding acceleration scheme built for GLM-5.3 that pairs a draft model able to propose candidates in parallel with a path-selection mechanism. In its own evaluation at TP=8 on 8×H200 with single concurrency, decode speed was about 288.2 tokens/s versus 84.5 tokens/s for native autoregressive decoding, a 3.41x gain, with total output throughput rising from 78.95 to 236.47 tokens/s. The report also says acceptance length exceeded IncoAI-DFlash2 and RedHat-DSpark across 1k–32k low-entropy contexts, and that at 64-way concurrency throughput reached 608.71 tokens/s, 44.9% above native decoding.
InfoQ 中文 AI&大模型 · 🔥 0
Experience and discussion from the community
Share my Alaya-DFlash2 experienceAsk about Alaya-DFlash2
Nobody has shared their experience with Alaya-DFlash2 yet.