ToRc
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Developer claims unreleased ToRc engine runs ~100GB Qwen model on two £300 ARM mini PCs
A developer posting on r/LocalLLaMA says an inference engine he is writing, codenamed ToRc and not yet released, reached 315 tok/s prompt read and 43 tok/s generation with Qwen3.6 35B A3B across two Snapdragon X mini PCs joined by a single USB4 cable, hardware he says cost about £600 in total. The same post reports 46 tok/s read and 20 tok/s generation for a roughly 95GB Qwen3.8 Flash Next IQ4_NL quant on the two boxes, versus 10.9/5.8 tok/s for llama.cpp over RPC, and 34.3/18.3 tok/s for a larger UD-Q4_K_XL quant. The author, who previously contributed ARM porting work to the Janas engine, says ToRc uses CPU cores plus the Hexagon NPU with no GPU involved; all figures are his own measurements and have not been independently verified.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my ToRc experienceAsk about ToRc
Nobody has shared their experience with ToRc yet.