Developer claims unreleased ToRc engine runs ~100GB Qwen model on two £300 ARM mini PCs
A developer posting on r/LocalLLaMA says an inference engine he is writing, codenamed ToRc and not yet released, reached 315 tok/s prompt read and 43 tok/s generation with Qwen3.6 35B A3B across two Snapdragon X mini PCs joined by a single USB4 cable, hardware he says cost about £600 in total. The same post reports 46 tok/s read and 20 tok/s generation for a roughly 95GB Qwen3.8 Flash Next IQ4_NL quant on the two boxes, versus 10.9/5.8 tok/s for llama.cpp over RPC, and 34.3/18.3 tok/s for a larger UD-Q4_K_XL quant. The author, who previously contributed ARM porting work to the Janas engine, says ToRc uses CPU cores plus the Hexagon NPU with no GPU involved; all figures are his own measurements and have not been independently verified.
If the numbers hold, a roughly 100GB open-weight model could run at chat speed on two sub-£400 ARM mini PCs without a GPU, though the engine remains unreleased and the results come from its own author.
Some source content is omitted. Continue reading on the original site.
#ToRc#Qwen3.6 35B A3B#Qwen3.8 Flash Next#Janas#llama.cpp#Qualcomm Snapdragon X#Lenovo IdeaCentre Mini