Qwen3.8-27B NVFP4
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- A dual-RTX 5060 Ti local LLM inference setup
A Reddit user reports running Qwen3.8-27B NVFP4 across two RTX 5060 Ti 16GB GPUs with capy-flash, OpenCode, tensor parallelism, MTP speculative decoding, and an int8 KV cache. The author says connecting both GPUs directly to CPU lanes reduced time to first token by about 2.5 times and doubled batching throughput compared with a chipset-connected card. Their reported configuration reaches 70–95 tokens per second for decoding, while Gen4 x8/x8 performance figures remain estimates.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my Qwen3.8-27B NVFP4 experienceAsk about Qwen3.8-27B NVFP4
Nobody has shared their experience with Qwen3.8-27B NVFP4 yet.