创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Lambda使用NVIDIA Photonics交换机连接逾万块GPU

AI 总结

NVIDIA称,云服务商Lambda正在使用NVIDIA Photonics共封装光学交换机连接包含逾1万块GPU的NVIDIA GB300 NVL72机架。根据NVIDIA报道的Lambda测试,机架级网络延迟下降约4%,Pod级最高下降约10%;在机架、可扩展单元和Pod配置下,吞吐量与传统可插拔光模块持平。NVIDIA还表示,此次部署可降低功耗、提高韧性并延长故障间隔时间。

深度见解

此次部署在数千块GPU协同工作的规模下应用了光子网络。NVIDIA表示,网络效率和韧性是AI工厂生产力的关键,因为链路中断可能使数千块GPU停摆,而用于网络的功耗也无法用于计算。

To train an AI model, thousands of GPUs have to work together, requiring a network that’s fast, efficient and resilient.

Lambda is tackling the network piece of the puzzle with NVIDIA Photonics co-packaged optics (CPO) switches. The cloud provider is using the switches to connect NVIDIA GB300 NVL72 racks with more than 10,000 GPUs, delivering lower power, higher resiliency and longer mean time between interruptions (MTBI) to an AI factory at scale.

“Networking has to keep pace with the demands of increasingly large AI clusters,” said Dave Ward, president of cloud services at Lambda. “Bringing co-packaged optics into a deployment of this scale is an important step toward building the infrastructure needed to support the next generation of AI.” 

Read All NVIDIA Announcements From SC26

In the company’s tests using the switches, network latency — the time needed for moving data — dropped by about 4% at rack scale and by up to about 10% at pod scale. Across rack, scalable unit and pod configurations, the network maintains the same throughput as conventional pluggable optics.

Delivering Power Efficiency and Resiliency at Scale

Improving power efficiency and resiliency matters because the network sits at the center of AI factory productivity. 

#NVIDIA#Lambda#NVIDIA Photonics#NVIDIA GB300 NVL72

原文约 2 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。