Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

QEngine 1.3.1 hits 504 tok/s in community Flash-Next test

AI summary

A r/LocalLLaMA user reports that QEngine 1.3.1 served Qwen3.8-Flash-Next at 406–504 tok/s in single-stream decoding on two RTX 5090 GPUs. The test also found QEngine roughly level with Strata on agentic prompt latency and faster at 10K-context prefill, while Strata led at 90K. The author cautions that repeated prompts and QEngine's adaptive expert cache put the decode result near best-case conditions, and the RAM-versus-VRAM comparison used only one boot and pass per mode.

In-depth insight

The report offers a detailed local-inference comparison, including the hardware, quantization, build changes, latency data, quality checks, and caching caveats, but its headline speed result comes from one community test rather than a controlled independent benchmark.

#QEngine 1.3.1#Qwen3.8-Flash-Next#Strata#vLLM#ThinkingCap 27B#RTX 5090

Original · 3 min readRead the original
Group chat

No comments yet. Start the conversation.