Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Sam Altman warns of two AI risks: lost control and concentrated power

AI summary

Sam Altman said on the Figuring Out With Raj Shamani podcast that AI could fail in two ways: people ceding control to systems more capable than themselves, and one person, company or country gaining excessive power over the technology. TechRadar, Wccftech and IT之家 AI reported the remarks, with Altman advocating competing AI efforts using different approaches while remaining optimistic about AI’s broader benefits.

In-depth insight

Altman’s warning highlights two prominent AI governance concerns—loss of human control and concentration of technological power—from the perspective of a major AI company CEO.

Sam Altman spends much of his time explaining how AI could transform the world for the better and pushing back against doomsayers. Nonetheless, the OpenAI CEO has some fairly unsettling ideas about how AI development could lead to a disaster, or disasters plural. He outlined a couple of these nightmares during an episode of the Figuring Out With Raj Shamani podcast in disturbing detail.

The two dystopias stem from almost opposite problems: either humanity losing control of increasingly powerful machines, or one group seizing control of most of the technology.

"One is that there’s a loss of control to AI, and we intentionally or accidentally sort of cede control of the future to systems that are unbelievably more capable than we are, and we can’t get it back," Altman said. "And the other is like, one person or company or country gets way too powerful relative to everybody else."

The first scenario is less the tired cliché of a robot uprising and more of a soft surrender of humanity's choices to AI until it's impossible to take back any agency from the AI software. The other is a more modern, if still clichéd, speculative-fiction scenario: an overwhelmingly powerful technology controlled by one person or corporation, leaving everyone else at their mercy. They are both endlessly discussed by people in the industry and policymakers, but having Altman issue the warning is still notable.

#OpenAI#Anthropic#SpaceX#Elon Musk#Dario Amodei#Mira Murati

Original · 4 min readRead the original
Group chat

No comments yet. Start the conversation.