Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Reddit user completes eight-RTX 3090 local AI rig

AI summary

A Reddit user reports completing a stable local AI rig built around eight matching Gigabyte Gaming OC RTX 3090 GPUs, an ASRock ROMED8-2T motherboard, PCIe 4.0 risers and CPU water cooling. The builder says the GPUs were bought by early 2026 for roughly £600–£700 each, with six operating at PCIe 4.0 x16 and two sharing a slot at PCIe 4.0 x8 each. They also report GPU peer-to-peer transfers of 22 GB/s, excluding the two x8 GPUs, and Qwen Flash generation of about 60 tokens per second for one agent and 370 tokens per second in aggregate for 10 parallel agents. The hardware, cost and performance figures are self-reported and have not been independently verified; the exact Qwen Flash model is not specified.

In-depth insight

The report documents a home-built, eight-GPU local AI system, including its hardware layout, inter-GPU configuration and reported inference performance, while remaining an unverified account from one user.

8x3090 my ocd wouldn't let me have different gpu models so ended up with 8 gigabyte gaming OC. I bought all the gpus by early 2026 before the prices went crazy. Avg maybe 600 to 700 gbp per gpu. Running on a Romed8-2t motherboard. All run at full pcie 4.0 x16 except the two rightmost who share one pcie slot and get 8x each. Cpu watercooling radiator sits nicely on top. Had to go the watercooling route as there is no space otherwise under the gpus for an air cooler. Using cheap pcie 4.0 risers from aliexpress. Longest ones are 60 and 40cm for the two leftmost gpus Two Psus, Ax1600i and hx1500i. One powers 5 gpus, the other powers the motherboard and 3 gpus (each gpu also pulls power through the motherboard at roughly 50W per gpu) Power limit set to 270W. Using modified nvidia drivers that enable p2p traffic between gpus, measured at a real 22GB/s except for the 8x gpus. I played around with some quant of qwen flash next on vllm and opencode. Single agent around 60 tok/sec gen and 10 agents in parallel peaked at aggregate 370 tok/sec gen. The more I look at what is available on the market right now (gorgon halo at 192gb etc) the more I realize what a monster I have built at home. Of course it consumes too much power, 300W idle, but it packs a punch when it comes to memory bandwidth and especially if I ever need to finetune some small models submitted by /u/dazzou5ouh [link] [comments]

#NVIDIA RTX 3090#Gigabyte Gaming OC#ASRock ROMED8-2T#Qwen Flash#vLLM#OpenCode

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.