NVIDIA RTX 3080 Laptop

Headlines · 1

1. 7d
   Lean-QwenFlash runs Qwen3.8-Flash-Next with low-memory NVMe offloading

   A developer reported that Lean-QwenFlash ran the 125B-parameter Qwen3.8-Flash-Next on an RTX 4090 with 16 GB of VRAM and 8 GB of allocated system RAM by directly offloading to an NVMe SSD. Using a 3.05 bpw configuration and a Q4 KV cache, the reported RTX 4090 results were 28–33 tokens per second for prose and 19–22 tokens per second for code at 8K context, with decode speeds of about 20.8 and 20.0 tokens per second at 100K and 262K context. An RTX 3080 Laptop test, with 16 GB of VRAM and 32 GB of RAM, reached about 18–21 tokens per second at 100K context. The developer also published setup instructions, model downloaders and packing scripts. The performance figures are self-reported in the original post.

   r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my NVIDIA RTX 3080 Laptop experienceAsk about NVIDIA RTX 3080 Laptop