创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Reddit 用户完成八卡 RTX 3090 本地 AI 主机

AI 总结

一名 Reddit 用户称,其本地 AI 主机已组装完成并保持稳定,配置包括八张一致的 Gigabyte Gaming OC RTX 3090、ASRock ROMED8-2T 主板、PCIe 4.0 转接线及 CPU 水冷。发帖者称,这些显卡在 2026 年初购入,单张约 600 至 700 英镑,其中六张以 PCIe 4.0 x16 运行,另外两张共享一个插槽、各以 PCIe 4.0 x8 运行。其还报告了除两张 x8 显卡外可达 22 GB/s 的 GPU 点对点传输速度,以及单智能体约 60 token/s、10 个智能体并行合计 370 token/s 的 Qwen Flash 生成表现。硬件、成本和性能数据均为发帖者自述,未经独立核实;报告也未说明具体的 Qwen Flash 模型。

深度见解

该报告记录了一套家用八卡本地 AI 系统,包括硬件布局、GPU 互联方式和推理性能,但这些信息仍是一名用户未经独立核实的自述。

8x3090 my ocd wouldn't let me have different gpu models so ended up with 8 gigabyte gaming OC. I bought all the gpus by early 2026 before the prices went crazy. Avg maybe 600 to 700 gbp per gpu. Running on a Romed8-2t motherboard. All run at full pcie 4.0 x16 except the two rightmost who share one pcie slot and get 8x each. Cpu watercooling radiator sits nicely on top. Had to go the watercooling route as there is no space otherwise under the gpus for an air cooler. Using cheap pcie 4.0 risers from aliexpress. Longest ones are 60 and 40cm for the two leftmost gpus Two Psus, Ax1600i and hx1500i. One powers 5 gpus, the other powers the motherboard and 3 gpus (each gpu also pulls power through the motherboard at roughly 50W per gpu) Power limit set to 270W. Using modified nvidia drivers that enable p2p traffic between gpus, measured at a real 22GB/s except for the 8x gpus. I played around with some quant of qwen flash next on vllm and opencode. Single agent around 60 tok/sec gen and 10 agents in parallel peaked at aggregate 370 tok/sec gen. The more I look at what is available on the market right now (gorgon halo at 192gb etc) the more I realize what a monster I have built at home. Of course it consumes too much power, 300W idle, but it packs a punch when it comes to memory bandwidth and especially if I ever need to finetune some small models submitted by /u/dazzou5ouh [link] [comments]

#NVIDIA RTX 3090#Gigabyte Gaming OC#ASRock ROMED8-2T#Qwen Flash#vLLM#OpenCode

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。