Three Used V100 GPUs Reach 100.8 Tokens/s With Qwen 3.6 35B
A homelab builder measured 100.8 tokens per second for Qwen 3.6 35B at Q8 on three used Nvidia V100 GPUs with a 4K context, falling to 72.7 tokens per second at 128K. Across more than 130 llama.cpp tests, the dense Qwen 3.6 27B managed 24.3 tokens per second at 4K. In the reported 128K run, the three-V100 build consumed about half the GPU energy of the three-P100 setup. The listed $1,042 price covers only the GPUs and selected components, excluding RAM, storage, the case, cooling, and one of the two CPUs.
The benchmark provides documented throughput, context-length, power, and price data for running Qwen 3.6 35B on used V100 GPUs. The results remain a single-builder measurement, and comparisons with newer hardware used different runtimes and test conditions.
A homelab builder benchmarked three used Nvidia V100s on Qwen 3.6 35B, achieving about 100 tokens per second in a custom setup costing $1,042 with just “e-waste” GPUs. The smaller, dense Qwen 3.6 27B manages about 24 tokens per second on the same platform, and the V100s use about half the energy of the same number of P100s for a given job.
A ~$1k GPU box full of "e-waste" (V100, P100) cards competes with modern hardware/inference APIs. Benchmarking Results incl. power consumption: from r/homelab
The blog post, “Scaling ‘E-Waste’: LLMs on Multiple Decommissioned GPUs,” compares nine different builds — one to three K80s, P100s, or V100-16GB cards — on a single Supermicro dual-Xeon board. The test uses llama.cpp and covers more than 130 LLM tests, including Qwen 2.5, Gemma 4, and, of course, Qwen 3.6, at Q4/Q8/F16 precisions and from 4K to 128K context sizes. GPU energy per run is also recorded. The builder is “daily driving Qwen 3.6 35B” on the V100s and notes that scaling decommissioned GPUs will only get you so far.
“E-waste,” in this case, refers to decommissioned enterprise GPUs, which are a popular but somewhat underpowered option when compared to very expensive modern alternatives. The Nvidia Tesla V100s in question are tested as a follow-up to a July round which tested 15 “e-waste” GPUs, and this time the board and CPUs stay the same for every build — the Supermicro X10DRG-Q with two Intel Xeon E5-2687W 12-core CPUs, powered by the Corsair HX1500i PSU.
#Qwen 3.6 35B#Qwen 3.6 27B#Nvidia V100#Nvidia P100#Nvidia H100#Nvidia B200#llama.cpp#oMLX#Nvidia DGX Spark#Apple M5 Max Mac Studio#Supermicro X10DRG-Q