NVIDIA发布Snapshot加速GPU推理恢复
NVIDIA发布开源组件Snapshot,作为NVIDIA DSX AI Factory Platform的一部分,用于在Kubernetes上检查点化和恢复已初始化的GPU工作负载。NVIDIA Technical Blog称其可捕获CPU与GPU内存状态,并在兼容基础设施上恢复副本,无需重复加载模型、编译或预热;合作伙伴测试称,GLM-5.3就绪时间从约8分钟降至31秒,vLLM启动时间从2至8.5分钟降至6至34秒。
Snapshot直接应对影响推理扩缩容与故障恢复的冷启动延迟,使AI基础设施团队能够复用已初始化的GPU工作负载,而不必为每个副本重新构建。
Kubernetes, the open source system that manages how applications run across thousands of AI factories, has become the foundation for AI, and the demands on it are only growing.
To help meet them, NVIDIA is deepening its commitment to open source at KubeCon + CloudNativeCon, the flagship conference for the Kubernetes and cloud-native communities.
NVIDIA is contributing NVIDIA OpenShell, an open source runtime for securing and governing autonomous agents, to the Cloud Native Computing Foundation (CNCF), a nonprofit that is part of the Linux Foundation and the host of KubeCon. As a CNCF Sandbox project, OpenShell will be governed by the organizations building it into their products and strengthened by the expertise of security professionals worldwide.
NVIDIA is also contributing to Agent Substrate, an open source Google-led framework for operating long-running agent workloads at scale on Kubernetes that has been accepted into the CNCF Sandbox.
Additionally, NVIDIA announced new components of the NVIDIA DSX AI Factory Platform: NVIDIA Kubernetes Engine, NVIDIA Kubernetes Recipes and NVIDIA Snapshot. These tools help teams deploy, manage and scale GPU infrastructure on Kubernetes for AI factories.
#NVIDIA#NVIDIA Snapshot#NVIDIA DSX AI Factory Platform#Kubernetes#vLLM#GLM-5.3#Crusoe#Saturn Cloud#NVIDIA HGX B300