Anthropic招股书披露AI安全困境
WIRED AI报道称,Anthropic首次公开的IPO招股书包含94页风险因素,并警告在缺乏适当保障、监督和安全措施的情况下,足够先进的AI系统可能带来灾难性或生存性风险。文件将相关风险与递归自我改进联系起来,称高度自主的系统可能在没有人类干预的情况下独立且大规模采取有害行动。Anthropic同时将“闭合回路”,即让AI系统自动执行AI研究与开发,描述为前沿AI领域的结构性竞争优势。
Anthropic在公开文件中同时披露了对AI风险的担忧及对AI驱动研发流程的依赖,为投资者和行业提供了观察这一矛盾的重要一手材料。
Anthropic has officially filed the prospectus for its initial public offering, which means the AI lab has put all kinds of formerly private information on display. While the prospectus contains the eye-popping revenue—and even larger expenditures—you might expect, the biggest section of the filing by far is given over to “risk factors,” which are all the things that could squash Anthropic’s big plans. Or, in this case, humanity itself.
While much has been made about the extent to which AI represents an existential threat to humankind, the specific mechanisms by which it could bring about that destruction are largely opaque. If nothing else, the 94 pages that Anthropic’s prospectus devotes to risk factors make clear both where it sees the danger coming from, and the ways in which its researchers are running toward it in order to win the AI arms race.
“Sufficiently advanced AI systems could, if not developed, deployed, and operated with appropriate safeguards, oversight and security measures, pose catastrophic or existential risks to humanity,” the prospectus reads, citing concerns both from critics and regulators and from inside Anthropic itself. (It’s the first of three times the phrase “existential risks” pops up.)