创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Reddit用户实测Mac上的DeepSeek-V4.1-Flash速度

AI 总结

一名r/LocalLLaMA用户称,其在512GB Mac Studio M5 Ultra上使用omlx运行DeepSeek-V4.1-Flash-1017-oQ4e-mtp。在128K上下文窗口下,用户报告提示词处理速度最高达每秒1,100个token,生成速度达每秒54个token。用户还表示,超过128K后性能会下降,并发请求会分摊生成吞吐量。

深度见解

该报告为DeepSeek-V4.1-Flash本地推理性能提供了早期硬件信号,但缺少正式且可复现的基准测试方法,数据的可信度因此受限。

I bought myself a Mac Studio M5 Ultra with 512gb ram (and have 7 weeks to test it and return if not happy thanks to the apple xmas offer).

I am running DeepSeek-V4.1-Flash-1017-oQ4e-mtp with omlx and I am getting up to 1100 t/s prompt processing and 54 t/s token generation with 128k context window and engrams stored on ssd (to have ram free for other stuff).

More context than 128k hits pp and tg, more concurrent requests split up the max tg value between the instances (which means: they are crawling then).

I am putting this out there so a) people know what to expect but also b) is this really the top speed? Or could it be faster? (Without changing the model).

I can post llama benchy results if wished but the important result is already in this post.

submitted by /u/vhthc [link] [comments]

#DeepSeek-V4.1-Flash-1017-oQ4e-mtp#Mac Studio M5 Ultra#omlx#Apple

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。