Lambda Uses NVIDIA Photonics Switches for More Than 10,000 GPUs
NVIDIA reports that cloud provider Lambda is using NVIDIA Photonics co-packaged optics switches to connect NVIDIA GB300 NVL72 racks containing more than 10,000 GPUs. In Lambda tests reported by NVIDIA, network latency fell by about 4% at rack scale and by up to about 10% at pod scale, while throughput matched conventional pluggable optics across rack, scalable-unit and pod configurations. NVIDIA also says the deployment delivers lower power use, greater resiliency and longer mean time between interruptions.
The deployment applies photonics networking at a scale where thousands of GPUs work together. NVIDIA says network efficiency and resiliency are central to AI-factory productivity because an interrupted link can stall thousands of GPUs, while power used by networking is unavailable for compute.
To train an AI model, thousands of GPUs have to work together, requiring a network that’s fast, efficient and resilient.
Lambda is tackling the network piece of the puzzle with NVIDIA Photonics co-packaged optics (CPO) switches. The cloud provider is using the switches to connect NVIDIA GB300 NVL72 racks with more than 10,000 GPUs, delivering lower power, higher resiliency and longer mean time between interruptions (MTBI) to an AI factory at scale.
“Networking has to keep pace with the demands of increasingly large AI clusters,” said Dave Ward, president of cloud services at Lambda. “Bringing co-packaged optics into a deployment of this scale is an important step toward building the infrastructure needed to support the next generation of AI.”
Read All NVIDIA Announcements From SC26
In the company’s tests using the switches, network latency — the time needed for moving data — dropped by about 4% at rack scale and by up to about 10% at pod scale. Across rack, scalable unit and pod configurations, the network maintains the same throughput as conventional pluggable optics.
Delivering Power Efficiency and Resiliency at Scale
Improving power efficiency and resiliency matters because the network sits at the center of AI factory productivity.