Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

MoEShift

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 2

  1. Qwen3.8-Flash-Next 125B benchmarked on 24GB Apple Silicon Macs

    A Reddit contributor benchmarked the 76GB-on-disk Qwen3.8-Flash-Next 125B GSQ-RCO IQ3_XXS quantization with the MoEShift backend on 24GB M4 Pro and M5 Pro Macs. Median results across three runs with prompt caching disabled included 374.15 tok/s prefill and 14.69 tok/s short-prompt decode on the M5 Pro, with peak physical process memory of 8.5GB on both systems.

    r/LocalLLaMA · 🔥 0
  2. Reddit user runs Qwen Flash Next at 24 tokens per second on Strata

    A Reddit user reports running Qwen Flash Next locally through Strata at 24 tokens per second on a 64GB M1 Max MacBook Pro. They say the model performs well for basic tasks but does not compete with larger frontier models. The report also mentions MoEShift and offloading larger models to SSD storage.

    r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my MoEShift experienceAsk about MoEShift

Nobody has shared their experience with MoEShift yet.