GB200

Headlines · 2

1. Oct 21
   vLLM adds day-0 support for Recursive's Flint 40B MoE

   vLLM said it supports Recursive's Flint from day 0, with both the NVFP4 and BF16 checkpoints running on a single GPU. Flint is a 40B-parameter mixture-of-experts model that activates about 2.5B parameters per token, uses sliding-window attention in most of its 49 layers and carries a 262K-token context. vLLM reports that a single request decodes at roughly 500 tokens/s on one GB200 even with 100K tokens of context, and that its Flint-specific kernels cut NVFP4 decode from 4.81 ms to 1.78 ms and reduced a forward pass from 1,096 kernels to 346.

   vLLM Blog · 🔥 0
2. Oct 19
   PyTorch Helion taps Nvidia CompileIQ to tune ptxas compiler controls

   A PyTorch blog post says Helion's kernel autotuner previously searched only tile shapes, warp counts, pipeline stages and memory access strategy, and can now also search ptxas compiler controls such as register allocation policy, fine-grained instruction scheduling and code-generation heuristics through Nvidia's CompileIQ, packaging results as portable Advanced Control Files (ACFs). In one example on a fixed, ahead-of-time-tuned NVFP4 GEMV kernel, an evolutionary CompileIQ search over eight generations with a pool of 15 candidates on GB200 cut execution time from 0.0971 ms to 0.0928 ms, a 1.047x (4.7%) speedup; the post stresses the gain is workload-specific and depends on shapes and architecture. Helion is open source under the PyTorch Foundation, while CompileIQ is proprietary but free to use under Nvidia's license, and the ACF files it produces are freely distributable.

   PyTorch Blog · 🔥 0

Experience and discussion from the community

Share my GB200 experienceAsk about GB200