Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Maxwell-V1-Flash

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 1

  1. Maxwell-V1-Flash brings 256K-context sparse attention to a 35B MoE

    The Maxwell Team introduced Maxwell-V1-Flash, a Mixture-of-Experts language model with 35B total parameters, 3B active parameters per token, and support for contexts up to 256K tokens. It uses Maxwell Block Sparse Attention, which combines fixed prefix and local blocks with remotely selected blocks, while Manifold-Constrained Hyper-Connections widen information flow across residual streams. The developer says its MBSA kernel is 6.7 times faster than dense GQA at 256K context length, but no methodology or independent measurement was provided.

    r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my Maxwell-V1-Flash experienceAsk about Maxwell-V1-Flash

Nobody has shared their experience with Maxwell-V1-Flash yet.