社区报告称混合GPU节点并发运行三款Qwen视觉模型
AI 总结
一名Reddit用户称，lvgale节点以Intel Core i7-6700K为CPU，并结合AMD RX 580、RX 570与NVIDIA GTX 1660 Super、GTX 1070。其定制的Nuitka编译Python引擎Slipstream据称通过混合厂商Vulkan后端和Flash Attention，并发运行Qwen3.8:27b-vision、Qwen3.5:9b-vision和Qwen3.5:2b-vision，速度分别为3.82、4.75和12.47 t/s。该帖子还称系统能在混合AMD与NVIDIA拓扑中稳定处理视觉任务，但性能和稳定性均未得到独立验证。
深度见解
这则报告展示了Slipstream作为一种实验性编排方案，在受限PCIe链路上跨AMD与NVIDIA异构硬件运行多个视觉模型的可能性。
Everyone loves a clean, unified server rack, but my standby node (lvgale) is an absolute physical abomination. It is a Frankenstein collection of mismatched parts and bolted-together VRAM that has no business running efficiently.
The Hardware Setup (lvgale)
The Software Engine
Concurrent Inference Performance
In all cases seamlessly handling OCR and complex vision parsing.
While the 2B model runs slightly faster on a modern laptop iGPU due to unified memory, keeping a 27B model stable across this mixed-architecture, low-bandwidth topology without crashing the Vulkan driver is a massive win. For deeper technical architecture details, the engine is documented at slipstream-llm.com. submitted by /u/FieldMouse-AI
[link] [comments] |
#Slipstream#Qwen3.8:27b-vision#Qwen3.5:9b-vision#Qwen3.5:2b-vision#AMD RX 580#AMD RX 570#NVIDIA GTX 1660 Super#NVIDIA GTX 1070#Intel Core i7-6700K