Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Reddit user reports strong Qwen 3.8 Flash Next performance with Basalt

AI summary

A Reddit user reports running the NVFP4 version of Qwen 3.8 Flash Next through Basalt on CachyOS with 64GB of RAM and an RTX 5090. The user reports 200 tokens per second decoding, about 9,000 tokens per second prefill, and a 256K context, while saying that Windows 11 memory overhead reduced performance.

In-depth insight

The post provides a first-hand local-inference configuration and performance data for a quantized Qwen model, offering practical evidence for users running large models on high-end consumer hardware.

#Qwen 3.8 Flash Next#Basalt#NVIDIA GeForce RTX 5090#CachyOS#Windows 11

Original · 2 min readRead the original
Group chat

No comments yet. Start the conversation.