Qwen3.6 35B A3B

Headlines · 1

1. Oct 22
   Developer claims unreleased ToRc engine runs ~100GB Qwen model on two £300 ARM mini PCs

   A developer posting on r/LocalLLaMA says an inference engine he is writing, codenamed ToRc and not yet released, reached 315 tok/s prompt read and 43 tok/s generation with Qwen3.6 35B A3B across two Snapdragon X mini PCs joined by a single USB4 cable, hardware he says cost about £600 in total. The same post reports 46 tok/s read and 20 tok/s generation for a roughly 95GB Qwen3.8 Flash Next IQ4_NL quant on the two boxes, versus 10.9/5.8 tok/s for llama.cpp over RPC, and 34.3/18.3 tok/s for a larger UD-Q4_K_XL quant. The author, who previously contributed ARM porting work to the Janas engine, says ToRc uses CPU cores plus the Hexagon NPU with no GPU involved; all figures are his own measurements and have not been independently verified.

   r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my Qwen3.6 35B A3B experienceAsk about Qwen3.6 35B A3B