ThinkingCap 27B
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- QEngine 1.3.1 hits 504 tok/s in community Flash-Next test
A r/LocalLLaMA user reports that QEngine 1.3.1 served Qwen3.8-Flash-Next at 406–504 tok/s in single-stream decoding on two RTX 5090 GPUs. The test also found QEngine roughly level with Strata on agentic prompt latency and faster at 10K-context prefill, while Strata led at 90K. The author cautions that repeated prompts and QEngine's adaptive expert cache put the decode result near best-case conditions, and the RAM-versus-VRAM comparison used only one boot and pass per mode.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my ThinkingCap 27B experienceAsk about ThinkingCap 27B
Nobody has shared their experience with ThinkingCap 27B yet.