Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Ex-OpenAI safety lead resigns, blasts company culture and 'iterative deployment'

AI summary

David Robinson, who spent three and a half years at OpenAI leading safety-transparency work, drafting its Preparedness Framework and overseeing safety evaluations attached to 12 frontier model releases, resigned and published a critical essay. He argued that OpenAI's touted "iterative deployment" approach is really trial and error, doomed to periodic failures whose scale grows with model capability, and called for frontier labs to run like nuclear plants with layered defence-in-depth plus a new science of safe behaviour without supervision. In the same week OpenAI said it parted ways with three safety-team researchers for mishandling sensitive company information; multiple outlets reported they had shared information about model safety issues with a third-party AI safety evaluator. An OpenAI spokesperson said the company keeps improving safeguards, will pause training or withhold models when needed, and is hardening its testing environments.

In-depth insight

It is the latest sign of sustained internal dissent over safety culture at frontier labs, a debate that shapes how AI risks get governed.

近日,美国知名媒体刊出一篇署名文章,标题是《我从OpenAI辞职,因为它的文化已经烂透了》。第一句话就是:“我本周从OpenAI辞职了。”

作者戴维·鲁滨逊在OpenAI工作了三年半,已经算是公司资历很老的中层主管之一。他主要负责安全透明度工作,主导起草了OpenAI现行的《预备框架》,并监督了12次前沿模型发布所附带的安全评估报告。过去几年外界读到的每一份OpenAI安全报告,大概都经过他的手。

实际上,作为资深中层,鲁滨逊仍然持有OpenAI的股权,而他的个人财富,也取决于他刚刚离开和炮轰的公司能否顺利上市获得华尔街认可。就在同一周,OpenAI刚刚解雇了三名安全团队的研究员。

试错文化导致周期失败

鲁滨逊在文章开头就承认,自己这么做“有点俗套”,似乎是又一个从顶尖AI公司离职,就公开发出严厉警告的员工。毕竟这样的案例在最近不胜枚举。

#OpenAI#Anthropic#Google DeepMind#Hugging Face#METR#AVERI

Original · 11 min readRead the original
Group chat

No comments yet. Start the conversation.