Four Tesla V100 GPUs beat two DGX Spark units in inference test
AI summary
The YouTube channel Jun Yamog posted an Oct 12 test running four 2017-era Nvidia Tesla V100 data-center GPUs on an NVLink carrier board with a 4-bit quantized Qwen3.8-Flash-Next model. The cluster was reported 40% faster than two DGX Spark units and 230% faster than an M5 Ultra Mac Studio on long-prompt processing, and 40% and 163% faster respectively on short prompts. Short-prompt token generation reached 100.6 tok/s, about 121% faster than the two DGX Sparks, while the M5 Ultra measured 44.5 tok/s. The tester said the large gap versus Apple Silicon may partly reflect weaker software optimization.
In-depth insight
It is a single enthusiast test, but it suggests older data-center GPUs can still offer notable inference throughput on certain workloads.