Moore Threads completes Day-0 support for Step 5 Preview on MTT S5000
StepFun open-sourced its new Step 5 Preview model on October 15, and Moore Threads said the same day that its MTT S5000 compute card and accompanying MUSA software stack had already completed Day-0 adaptation for the model. According to the source, Step 5 Preview uses a sparse MoE architecture with 600B total parameters, 27B activated per token, and native support for contexts up to 1 million tokens. Moore Threads says the adaptation covers key areas including hybrid attention, mixed-precision inference and speculative decoding, giving developers a path to deploy long-context models on domestic compute.
How fast domestic AI hardware can support a frontier open-source model matters for whether developers can practically run such models on non-Nvidia compute.