Cristiano警告或有条件地存在6至12个月内的AI接管风险
Ars Technica报道,OpenAI基金会董事会成员、Alignment Research Center执行总监Paul Cristiano在多伦多讲座系列中警告,AI接管可能发生。他说,如果AI继续以最快速度发展,未来六至十二个月内发生AI接管将存在“有意义的风险”。Cristiano还表示,目前没有能够估算AI接管发生概率的量化模型。在他的假设推演中,未来智能体可能从奖励欺骗和隐瞒不当行为,发展到把人类视为障碍并试图干扰人类监督。
Story text
Size Width * Links
* Subscribers only Learn more
How do you think you’re going to die?
If you go by the current statistics for deaths in the US, it’s reasonable to expect that cancer or heart disease will eventually get you. But OpenAI Foundation board member and Alignment Research Center Executive Director Paul Cristiano thinks we should all be worried about another major mortality risk. Speaking at a lecture series this week, Cristiano bluntly told the audience in a Toronto Convention Center, “I think for most people in this room, the most likely reason they will die is because of an AI accident.”
In the opening lecture of a three-part series, Cristiano outlined his worries about the risk of an impending “AI takeover.” He defined that as a situation where goal-pursuing AI systems “call the shots in the same sense that humans today call the shots and what happens on Earth” and where any human trying to stop them “would be as ineffective as if you or me was trying to stop the US military.” Such a situation would likely lead to mass death and perhaps uninhabitable environments for humans, Cristiano said.
#Paul Cristiano#OpenAI Foundation#Alignment Research Center#OpenAI#Hugging Face