Muir
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Muir linear-attention model targets long-context recall and streaming
The Muir paper introduces a linear-attention architecture that combines sensitivity-allocated gating, matched-filter readout, and a numerically stable parallel update. Its authors report lower perplexity and stronger recall than Gated DeltaNet-2 and Transformer baselines, along with 10M-token streaming from a 4K training length and near-perfect passkey retrieval up to 1M tokens. A Reddit analysis also describes a 25 MB state at 10M tokens, but these technical and benchmark claims have not been independently confirmed.
Hugging Face · Papers · 🔥 0
Experience and discussion from the community
Share my Muir experienceAsk about Muir
Nobody has shared their experience with Muir yet.