GSQ-RCO IQ3_XXS
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Qwen3.8-Flash-Next 125B benchmarked on 24GB Apple Silicon Macs
A Reddit contributor benchmarked the 76GB-on-disk Qwen3.8-Flash-Next 125B GSQ-RCO IQ3_XXS quantization with the MoEShift backend on 24GB M4 Pro and M5 Pro Macs. Median results across three runs with prompt caching disabled included 374.15 tok/s prefill and 14.69 tok/s short-prompt decode on the M5 Pro, with peak physical process memory of 8.5GB on both systems.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my GSQ-RCO IQ3_XXS experienceAsk about GSQ-RCO IQ3_XXS
Nobody has shared their experience with GSQ-RCO IQ3_XXS yet.