Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

NVIDIA AICR Ships Preview Vera Rubin Kubernetes Recipes

AI summary

NVIDIA says the AI Cluster Runtime (AICR), part of the NVIDIA DSX AI Factory Platform, now captures tuned Kubernetes configurations as reusable recipes, renders ordered Helm chart bundles, and validates running clusters so platform teams can be ready for NVIDIA Vera Rubin NVL72 compute trays on day one. The open-source NVIDIA/aicr repository publishes v1.0.0 preview recipes for the rke2 service and the vr200 accelerator, including training recipes validated across deployment, conformance, and an NCCL performance phase, plus an inference variant for Dynamo. The blog also notes Vera Rubin requires a new driver branch (R615.23 tested, R610 targeted for early support, R620 for official platform support) and swaps ConnectX-7/BlueField-3 for ConnectX-9 SuperNICs with BlueField-4 DPUs. NVIDIA also reports that validation surfaced an unmapped Rubin architecture value in go-nvlib, fixed in go-nvlib 0.12.0 and shipped in DRA driver v0.5.0.

In-depth insight

The preview recipes give platform teams a reproducible, machine-verifiable path to stand up Kubernetes clusters on new Vera Rubin racks, and the published signed validation evidence is something practitioners can check against their own builds.

Configuring and optimizing Kubernetes for new GPU hardware such as NVIDIA Vera Rubin is complex and error-prone. Drivers, kernels, runtimes, networking, operators, and schedulers must work together, with settings tuned to the hardware and workload. Small mismatches can prevent workloads from running or limit performance. 

The NVIDIA AI Cluster Runtime (AICR)—part of the NVIDIA DSX AI Factory Platform—simplifies this work by capturing tuned configurations in reusable recipes, generating bundles for existing deployment tools, and validating the running cluster. It will help Kubernetes environments be ready for NVIDIA Vera Rubin NVL72 compute trays on Day 1.

Overall, the NVIDIA DSX AI Factory Platform brings together technologies to help the ecosystem design, build, and operate more efficient AI factories, including open source, modular software components purpose-built to support multi-tenant operations and scaling. 

Configuring new hardware architecture in a cloud-native stack requires plumbing updates from the lowest-level bindings all the way up to the orchestration layer. It is still early days for Vera Rubin.

This post covers what changes if you run NVIDIA GB200 NVL72 today, what has been validated on early hardware access using NVIDIA GPU Operator and the Dynamic Resource Allocation (DRA) driver with Vera Rubin support. It also shows how AICR brings these components together in a configuration that platform teams can reproduce and verify.

#NVIDIA#NVIDIA AI Cluster Runtime (AICR)#NVIDIA DSX AI Factory Platform#NVIDIA Vera Rubin NVL72#NVIDIA GB200 NVL72#NVIDIA GPU Operator#NVIDIA Dynamo#NVIDIA KAI Scheduler#NVIDIA NVSentinel#NVIDIA ConnectX-9 SuperNIC#NVIDIA BlueField-4 DPU#NVIDIA Dynamo inference

Original · 12 min readRead the original
Group chat

No comments yet. Start the conversation.