cuBLASLt
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- 4-bit GPT training speeds up on a single Nvidia B200
VizuaraAI's author reports training GPT models end to end on one Nvidia B200 with an NVFP4 forward pass, an FP8 backward pass using stochastic rounding, and high-precision master weights. For the 840M-parameter model, 2,000 steps took about 4.3 minutes versus 5.5 minutes in BF16, while final validation losses were 1.691 and 1.688 respectively. Reported per-step speedups ranged from 18% for the 219M model to 38% for the 3.3B model, although the largest run covered only 1,000 steps.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my cuBLASLt experienceAsk about cuBLASLt
Nobody has shared their experience with cuBLASLt yet.