Qwen3.8-Flash-Next NVFP4
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Seven Qwen 3.8 FN Inference Engines Benchmarked on One RTX 5090
The developer of Basalt benchmarked seven Qwen 3.8 FN inference engines on an RTX 5090 with 128 GB of RAM. The report’s results placed Basalt and Infernix ahead overall: Basalt recorded 354 tokens per second for structured output and 190 tokens per second at 25K context, while both reached a 3.94-second time to first token at 25K. Each engine converted NVIDIA’s NVFP4 weights with its own tool and was configured according to its documentation. Every engine received the same seven greedy requests, with one cold run per request and no warm-up.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my Qwen3.8-Flash-Next NVFP4 experienceAsk about Qwen3.8-Flash-Next NVFP4
Nobody has shared their experience with Qwen3.8-Flash-Next NVFP4 yet.