Mamba-1

Headlines · 1

1. 2d
   Developer Ports PyTorch 2.7.1 and Mamba-1 to Legacy NVIDIA GPUs

   A developer announced a Windows port of an LLM training stack for NVIDIA GPUs from SM 3.5 through SM 7.5, including a custom PyTorch 2.7.1 build with CUDA 11.8, ported causal-conv1d, native-CUDA Mamba-1 and Windows NCCL. The author reports that Mamba-1 works across those architectures and achieved a maximum absolute error of 3.8e-06 against a PyTorch reference on a 2013 Tesla K40c. Mamba-2 and Mamba-3 require Turing or newer because they depend on Triton and TileLang, while older GPUs automatically fall back to Mamba-1.

   r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my Mamba-1 experienceAsk about Mamba-1