创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

RTX 8000 48GB用户分享降价与本地推理体验

AI 总结

一名 Reddit 用户称,其 2024 年以 2,400 美元购买的 NVIDIA RTX 8000 48GB,两年后售价约为 2,100 美元。该用户表示,RTX 8000 的推理速度略慢于 RTX 3090,但显存翻倍,在容量相当的情况下功耗更低,且两年内未遇到驱动或兼容性问题。其多款本地模型可完全载入显存运行,通常达到 256k tokens,更大的 MoE 模型则会将部分层卸载至系统内存。

深度见解

这份使用记录为高显存 GPU 选购提供了价格、功耗和本地推理方面的具体参考,但相关数据来自单一 Reddit 用户,尚未经过独立测试验证。

In 2024 i purchased an RTX 8000 48gb for $2400. As the market has changed I’ve kept an eye on prices. Two years later, they are available around $2100.

Its a little slower than 3090 at inference (672gb/s vs 936gb/s) but it has double the memory so it can run larger models / contexts / higher quants. Rtx 8000 also wins on power, 265w vs 700w (2x 3090 to match 48gb)

In 2024 two 3090s would cost around $1600-1800 now a single 3090 is in the $1500-$1600 range, making rtx 8000 cheaper per gb. Prices for strix halo and dgx spark have also gone way up. Rtx pro 6000 has double the memory but 8x the cost.

In the last two years, I haven’t had any issues with drivers, compatibility software or anything. I can run all “local” tier models entirely in vram, usually at 256k tokens and sometimes at q6 (Qwen 3.8 27b, llama 3 70b, QWQ,). Larger moe models run great too with layers offloaded to system ram like gpt oss 120b and now with strata, QFN runs q4_xs @ 390k context at 850t/s prompt processing and 60-70t/s token generation. (64gb ddr4 system memory, i9 9900k cpu)

$2100 for a gpu is not cheap but might be the best “do everything” option right now for home-lab setups. Cheaper than dual 3090, Strix halo, dgx spart, m5 max too. Fascinating to see prices decline as the market as a whole has more than doubled.

submitted by /u/triynizzles1 [link] [comments]

#NVIDIA RTX 8000 48GB#NVIDIA RTX 3090#NVIDIA RTX PRO 6000#Qwen 3.8 27B#Llama 3 70B#GPT-OSS 120B

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。