创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Anthropic警示RSI门槛或将近

AI 总结

Anthropic修订后的S-1/A称,基于对未来模型的内部预估,公司可能很快达到《负责任规模化政策》中“由AI带来的显著加速进展”阈值,该政策领域涉及递归自我改进。据TechCrunch报道,文件还称AI辅助研发过去曾带来未被及时察觉的能力提升,但目前没有现有模型被认定已越过门槛,相关数据仍在评估。

深度见解

随着Anthropic以AI加速自身研发,这项披露凸显了模型能力进展可能快于安全、对齐和安保措施开发与部署的风险。

While much attention has focused on the updated financials Anthropic revealed in its revised S-1A on Monday, (revenue is soaring, but so are expenses), the AI lab dropped another little bombshell in the fine print.

The filing seems to warn that the company is on the cusp of creating a model capable of recursive self-improvement (RSI).

RSI is the point at which AI grows so good at training itself that it spawns a dramatic acceleration of AI capabilities. To the AI doomers, RSI represents the cataclysm from which there is no return, in which AI builds itself into something powerful enough that it slips beyond human control and may be indifferent to the damage it causes while achieving its goals.

To AI enthusiasts, RSI, or some version of AI reliably using itself to improve, represents the technology’s promise, where it becomes a tool of unimaginable productivity, scientific discovery, and more.

Anthropic seems to believe that RSI is both a promise and a peril. It says in the S-1 that it uses AI in its R&D, but it cautions: “Using AI to help build more capable AI could also pose a considerable safety risk, particularly if it sharply accelerates the pace of progress. This is one of the areas covered by our Responsible Scaling Policy, which sets out our plans to monitor and mitigate the risks as we approach what has been termed ‘recursive self-improvement.’”

#Anthropic#Claude#Responsible Scaling Policy

原文约 3 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。