Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

RTX 8000 48GB owner reports lower price and strong local AI use

AI summary

A Reddit user says NVIDIA’s RTX 8000 48GB, bought for $2,400 in 2024, was available around $2,100 two years later. The owner reports slightly slower inference than an RTX 3090 but twice the memory, lower power use for equivalent capacity, and no driver or compatibility issues over two years. They also say the card ran several local models entirely in VRAM, usually at 256k tokens, while larger MoE models used some system memory offload.

In-depth insight

The account offers concrete pricing, power and local-inference observations for buyers considering a high-memory GPU, but the figures come from one Reddit user rather than independent testing.

In 2024 i purchased an RTX 8000 48gb for $2400. As the market has changed I’ve kept an eye on prices. Two years later, they are available around $2100.

Its a little slower than 3090 at inference (672gb/s vs 936gb/s) but it has double the memory so it can run larger models / contexts / higher quants. Rtx 8000 also wins on power, 265w vs 700w (2x 3090 to match 48gb)

In 2024 two 3090s would cost around $1600-1800 now a single 3090 is in the $1500-$1600 range, making rtx 8000 cheaper per gb. Prices for strix halo and dgx spark have also gone way up. Rtx pro 6000 has double the memory but 8x the cost.

In the last two years, I haven’t had any issues with drivers, compatibility software or anything. I can run all “local” tier models entirely in vram, usually at 256k tokens and sometimes at q6 (Qwen 3.8 27b, llama 3 70b, QWQ,). Larger moe models run great too with layers offloaded to system ram like gpt oss 120b and now with strata, QFN runs q4_xs @ 390k context at 850t/s prompt processing and 60-70t/s token generation. (64gb ddr4 system memory, i9 9900k cpu)

$2100 for a gpu is not cheap but might be the best “do everything” option right now for home-lab setups. Cheaper than dual 3090, Strix halo, dgx spart, m5 max too. Fascinating to see prices decline as the market as a whole has more than doubled.

submitted by /u/triynizzles1 [link] [comments]

#NVIDIA RTX 8000 48GB#NVIDIA RTX 3090#NVIDIA RTX PRO 6000#Qwen 3.8 27B#Llama 3 70B#GPT-OSS 120B

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.