NVIDIA AI Cluster Runtime (AICR)
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 3
- NVIDIA AICR Adds Qualified AIBOM Support for Kubernetes AI Workloads
NVIDIA says its open-source AI Cluster Runtime (AICR) now includes a qualified AI bill of materials component that integrates Google's k8s-aibom to inventory recognized AI workloads on Kubernetes. The integration supports version-locked deployment bundles, provenance and security-default checks, and per-namespace opt-in inventory, while NVIDIA reports low controller overhead in a GKE test using k8s-aibom v1.6.1. Runtime observations are not signed by default, and linking them with verified provenance and deployment intent remains unfinished work.
NVIDIA Technical Blog · 🔥 0 - NVIDIA AICR Ships Preview Vera Rubin Kubernetes Recipes
NVIDIA says the AI Cluster Runtime (AICR), part of the NVIDIA DSX AI Factory Platform, now captures tuned Kubernetes configurations as reusable recipes, renders ordered Helm chart bundles, and validates running clusters so platform teams can be ready for NVIDIA Vera Rubin NVL72 compute trays on day one. The open-source NVIDIA/aicr repository publishes v1.0.0 preview recipes for the rke2 service and the vr200 accelerator, including training recipes validated across deployment, conformance, and an NCCL performance phase, plus an inference variant for Dynamo. The blog also notes Vera Rubin requires a new driver branch (R615.23 tested, R610 targeted for early support, R620 for official platform support) and swaps ConnectX-7/BlueField-3 for ConnectX-9 SuperNICs with BlueField-4 DPUs. NVIDIA also reports that validation surfaced an unmapped Rubin architecture value in go-nvlib, fixed in go-nvlib 0.12.0 and shipped in DRA driver v0.5.0.
NVIDIA Technical Blog · 🔥 0 - NVIDIA AICR validates Kubernetes runtimes for Dynamo inference
NVIDIA Technical Blog details how NVIDIA AI Cluster Runtime (AICR) packages NVIDIA Dynamo and its supporting Kubernetes infrastructure into versioned, validated recipes. The Dynamo recipe pins the dynamo-platform chart to version 1.4.2 and defines component versions, compatibility constraints, deployment checks, and conformance checks covering GPUs, scheduling, observability, and ingress. The walkthrough also compares Dynamo Frontend and Gateway API/EPP routing and explains the planned native Rust EPP path in Dynamo 1.5.
NVIDIA Technical Blog · 🔥 0
Experience and discussion from the community
Share my NVIDIA AI Cluster Runtime (AICR) experienceAsk about NVIDIA AI Cluster Runtime (AICR)
Nobody has shared their experience with NVIDIA AI Cluster Runtime (AICR) yet.