Reddit user reports DeepSeek-V4.1-Flash speeds on Mac Studio M5 Ultra
A Reddit user in r/LocalLLaMA reports running DeepSeek-V4.1-Flash-1017-oQ4e-mtp with omlx on a 512GB Mac Studio M5 Ultra. They report up to 1,100 tokens per second for prompt processing and 54 tokens per second for generation at a 128K context window. The user also says performance declines beyond 128K and concurrent requests divide the available generation throughput.
The report offers an early hardware signal for local DeepSeek-V4.1-Flash inference, but its lack of formal, reproducible benchmark methodology limits confidence in the figures.
I bought myself a Mac Studio M5 Ultra with 512gb ram (and have 7 weeks to test it and return if not happy thanks to the apple xmas offer).
I am running DeepSeek-V4.1-Flash-1017-oQ4e-mtp with omlx and I am getting up to 1100 t/s prompt processing and 54 t/s token generation with 128k context window and engrams stored on ssd (to have ram free for other stuff).
More context than 128k hits pp and tg, more concurrent requests split up the max tg value between the instances (which means: they are crawling then).
I am putting this out there so a) people know what to expect but also b) is this really the top speed? Or could it be faster? (Without changing the model).
I can post llama benchy results if wished but the important result is already in this post.
submitted by /u/vhthc [link] [comments]
#DeepSeek-V4.1-Flash-1017-oQ4e-mtp#Mac Studio M5 Ultra#omlx#Apple