QEngine 1.3.1 hits 504 tok/s in community Flash-Next test
A r/LocalLLaMA user reports that QEngine 1.3.1 served Qwen3.8-Flash-Next at 406–504 tok/s in single-stream decoding on two RTX 5090 GPUs. The test also found QEngine roughly level with Strata on agentic prompt latency and faster at 10K-context prefill, while Strata led at 90K. The author cautions that repeated prompts and QEngine's adaptive expert cache put the decode result near best-case conditions, and the RAM-versus-VRAM comparison used only one boot and pass per mode.
The report offers a detailed local-inference comparison, including the hardware, quantization, build changes, latency data, quality checks, and caching caveats, but its headline speed result comes from one community test rather than a controlled independent benchmark.