奥特曼据报向员工提出三种AI安全终局
据《The Rundown AI》转述《The Information》的报道，OpenAI 首席执行官 Sam Altman 上周在一次内部讲话中提出 AI 安全的三种可能终局。其一是仿照国际原子能机构建立的全球执法机构，报道称 Altman 倾向这一方案；其二是以 DeepMind 联合创始人 Demis Hassabis 命名的“Demis 方案”，即把顶尖实验室合并为一家、以类似 CERN 的方式服务伙伴国家；其三是以 AI 研究者 Eliezer Yudkowsky 命名的情形——某家实验室凭借自我改进的 AI“烧掉其他所有人的 GPU”，Altman 称其“很糟糕”。报道还称，Altman 把 OpenAI 目前“模型通过安全测试即发布”的做法称为“pacing 1.0”，并表示需在一年内选定路径，即“pacing 2.0”，其中必须为自我改进的 AI 设定“限速”或停止点。
报道称，奥特曼的这些设想与 Anthropic 的 Jack Clark 的说法似乎一致，后者谈到智能上限，并表示世界只有“少数几年”时间来就安全采取行动。
摘自汇总《Sam Altman’s three endings for the AI safety ra…》
The details:
- The report claims Altman favored plan 1: a global enforcer built like the International Atomic Energy Agency, which OAI has lobbied for since 2023.
- The “Demis plan” (named after DeepMind co-founder Demis Hassabis) folds top labs into one lab serving partner countries, similar to CERN’s particle research.
- Altman called plan three (named for AI researcher Eliezer Yudkowsky) “terrible,” with one lab riding self-improving AI to “melt everyone else’s GPUs.”
- He called picking a path, due within a year, “pacing 2.0,” and said it must include a “speed limit” or stopping point for self-improving AI.
Why it matters: Anthropic’s Jack Clark just talked about an intelligence cap and said the world has “a small number of years” to act on safety — and Altman’s scenarios seem aligned with his No. 1 rival. An Avengers-style team-up of top labs under one roof would make for a fun plot, but as with every pact so far, getting the rest of the field is not easy.
#OpenAI#Sam Altman#DeepMind#Demis Hassabis#International Atomic Energy Agency#CERN#Anthropic#Jack Clark#Eliezer Yudkowsky