Sam Altman warns of two AI risks: lost control and concentrated power
Sam Altman said on the Figuring Out With Raj Shamani podcast that AI could fail in two ways: people ceding control to systems more capable than themselves, and one person, company or country gaining excessive power over the technology. TechRadar, Wccftech and IT之家 AI reported the remarks, with Altman advocating competing AI efforts using different approaches while remaining optimistic about AI’s broader benefits.
Altman’s warning highlights two prominent AI governance concerns—loss of human control and concentration of technological power—from the perspective of a major AI company CEO.
Sam Altman spends much of his time explaining how AI could transform the world for the better and pushing back against doomsayers. Nonetheless, the OpenAI CEO has some fairly unsettling ideas about how AI development could lead to a disaster, or disasters plural. He outlined a couple of these nightmares during an episode of the Figuring Out With Raj Shamani podcast in disturbing detail.
The two dystopias stem from almost opposite problems: either humanity losing control of increasingly powerful machines, or one group seizing control of most of the technology.
"One is that there’s a loss of control to AI, and we intentionally or accidentally sort of cede control of the future to systems that are unbelievably more capable than we are, and we can’t get it back," Altman said. "And the other is like, one person or company or country gets way too powerful relative to everybody else."
The first scenario is less the tired cliché of a robot uprising and more of a soft surrender of humanity's choices to AI until it's impossible to take back any agency from the AI software. The other is a more modern, if still clichéd, speculative-fiction scenario: an overwhelmingly powerful technology controlled by one person or corporation, leaving everyone else at their mercy. They are both endlessly discussed by people in the industry and policymakers, but having Altman issue the warning is still notable.