Reddit user runs Qwen3.8-27B at 65K context on an RTX 3060
A Reddit user reports running ISTA-DASLab's Qwen3.8-27B-GSQ-RCO-GGUF with IQ3_XSS quantization and TurboQuant on a GeForce RTX 3060 at a 65,536-token context, while offloading the multimodal projector to CPU RAM. The user says the setup handled reasoning-intensive agent tasks on-device, but the report provides no independent benchmark or verification.
The post supplies a concrete local-inference configuration that may help users explore a large Qwen model on consumer hardware, although its performance remains an anecdotal claim.
Hey guys
I am a seasoned local llm user and I ain't quite ram rich like only 16gb ddr4 🥀
So I can't run qwen3.8 flash next on my 3060
This guy felt the best for me yet
Have you guys tried it
I have ran iq3_xss quant non mtp with turboquant at 65k context completely on my 3060 though I did offload mmproj to cpu ram
#ISTA-DASLab#Qwen3.8-27B-GSQ-RCO-GGUF#Qwen#NVIDIA GeForce RTX 3060#TurboQuant#llama.cpp#Pi coding agent