Laptop owner reports strong local LLM results with Strata
A r/LocalLLaMA user reports that Strata enabled an MSI Vector 16 with an Intel Core Ultra 9, RTX 5080 and upgraded laptop memory to run Qwen Q4 XL Flash at 48.9 tokens per second. The post also lists a combined decode/prefill figure of 1,860 tokens per second with a 50,000-token prompt, plus a reported 25 tokens per second for GLM 5.3 Flash in Q3_XSS. The owner says the roughly £3,100 setup can also use external GPUs for 80 GB of total VRAM.
The account suggests that Strata and expandable laptop memory may make higher-throughput local LLM use possible, but it is an unverified user report without controlled testing or independent reproduction.
I've been frustrated for a while because I stupidly sold a strix halo box to get myself a laptop with thunderbolt 5 ports thinking i can plug my two egpus into it (which i can but thats not topic of this post and the strix halo could too) I sold the minisforum for about £2300 back ebfore things went nuts and got a laptop for about same price:
Msi vector 16 with a intel core ultra 9 and 5080(16 gig vram) and 32 gig of ram. I was pretty bummed with it thinking 35b was my limit and after ended up leaving egpus in my workstatiion but after a random ebay browse I managed to snag some second hand 96 gig laptop ram. For £800
Strata totally changed ballgame. With Qwen Q4 XL Flash next I'm getting
48.9t/s
Decode/prefill 1,860t/s
On a 50k prompt.
#Strata#MSI Vector 16#Qwen Q4 XL Flash#GLM 5.3 Flash#Intel Core Ultra 9#NVIDIA GeForce RTX 5080#Minisforum Strix Halo