AI data centers hit grid, cooling and interconnect limits
A TechRadar explainer lays out the grid, thermal and interconnect bottlenecks limiting AI data center growth: modern GPU racks now draw 50 to 100 kW per cabinet, while traditional air cooling was not built for densities above 30 to 40 kW, and temperatures of 90 to 100 degrees trigger throttling, with two-phase immersion cooling reported to cut cooling energy by up to 40%. It says electrical copper interconnects lose signal strength beyond two meters and halve their usable reach each time bandwidth requirements double, optical interconnects can cost up to 7x more in some GPU setups, and high-voltage transformer wait times have stretched from 6–12 months in 2020 to two to four years today, with new Northern Virginia facilities facing waits of up to 14 years for a grid connection. The piece also cites responses such as xAI adding 59 portable natural gas turbines with over 400 MW combined capacity for its Colossus data center in Memphis, Siemens partnering with Reinhausen to mass-produce a modular solid-state transformer for AI data centers at 97–99% efficiency, and, per Edison Electric, $208 billion of US grid investment in 2025 plus $1.1 trillion planned from 2025 to 2030.
Power, cooling and interconnect constraints are becoming the practical limit on AI compute buildout, shaping when new clusters come online and at what cost.