九章云极 (AlayaNeW)

Headlines · 1

1. Oct 20
   AlayaNeW open-sources Alaya-DFlash2, claiming 3.41x GLM-5.3 decode speedup

   AlayaNeW (九章云极) released and open-sourced Alaya-DFlash2, a speculative-decoding acceleration scheme built for GLM-5.3 that pairs a draft model able to propose candidates in parallel with a path-selection mechanism. In its own evaluation at TP=8 on 8×H200 with single concurrency, decode speed was about 288.2 tokens/s versus 84.5 tokens/s for native autoregressive decoding, a 3.41x gain, with total output throughput rising from 78.95 to 236.47 tokens/s. The report also says acceptance length exceeded IncoAI-DFlash2 and RedHat-DSpark across 1k–32k low-entropy contexts, and that at 64-way concurrency throughput reached 608.71 tokens/s, 44.9% above native decoding.

   InfoQ 中文 AI&大模型 · 🔥 0

Experience and discussion from the community

Share my 九章云极 (AlayaNeW) experienceAsk about 九章云极 (AlayaNeW)