Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Mamba on Clunkers

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 1

  1. Developer Ports PyTorch 2.7.1 and Mamba-1 to Legacy NVIDIA GPUs

    A developer announced a Windows port of an LLM training stack for NVIDIA GPUs from SM 3.5 through SM 7.5, including a custom PyTorch 2.7.1 build with CUDA 11.8, ported causal-conv1d, native-CUDA Mamba-1 and Windows NCCL. The author reports that Mamba-1 works across those architectures and achieved a maximum absolute error of 3.8e-06 against a PyTorch reference on a 2013 Tesla K40c. Mamba-2 and Mamba-3 require Turing or newer because they depend on Triton and TileLang, while older GPUs automatically fall back to Mamba-1.

    r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my Mamba on Clunkers experienceAsk about Mamba on Clunkers

Nobody has shared their experience with Mamba on Clunkers yet.