创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

用户称 Strata 提升笔记本本地大模型性能

AI 总结

一名 r/LocalLLaMA 用户称,配备 Intel Core Ultra 9、RTX 5080 并升级内存的 MSI Vector 16 使用 Strata 运行 Qwen Q4 XL Flash 时达到每秒 48.9 个 token。帖子还称,在 5 万 token 的提示下,解码与预填充合计达到每秒 1,860 个 token,并以 Q3_XSS 运行 GLM 5.3 Flash 时达到每秒 25 个 token。用户表示,总价约 3,100 英镑的这套设备还可连接外置 GPU,获得共 80GB 显存。

深度见解

这则体验显示,Strata 与可扩展的笔记本内存或许能提升本地大模型部署效率,但数据来自单一用户,尚无受控测试或独立复现。

I've been frustrated for a while because I stupidly sold a strix halo box to get myself a laptop with thunderbolt 5 ports thinking i can plug my two egpus into it (which i can but thats not topic of this post and the strix halo could too) I sold the minisforum for about £2300 back ebfore things went nuts and got a laptop for about same price:

Msi vector 16 with a intel core ultra 9 and 5080(16 gig vram) and 32 gig of ram. I was pretty bummed with it thinking 35b was my limit and after ended up leaving egpus in my workstatiion but after a random ebay browse I managed to snag some second hand 96 gig laptop ram. For £800

Strata totally changed ballgame. With Qwen Q4 XL Flash next I'm getting

48.9t/s

Decode/prefill 1,860t/s

On a 50k prompt.

#Strata#MSI Vector 16#Qwen Q4 XL Flash#GLM 5.3 Flash#Intel Core Ultra 9#NVIDIA GeForce RTX 5080#Minisforum Strix Halo

原文约 2 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。