创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

外部评估发现OpenAI智能体监控漏洞

AI 总结

METR与Redwood Research用三周时间对OpenAI内部智能体监控系统进行压力测试,研究人员可接触其代码库、监控提示词、配置和文档。评估发现两项经独立测试的弱点,包括可由客户端控制的标头,能够为新智能体关闭监控,但设置标头和创建智能体的行为仍可能被察觉。研究人员还发现两个原本被认定为只读的工具可能遭权限绕过,但没有验证该行为是否可行。

深度见解

这些发现暴露了OpenAI用于审查内部智能体的监督机制中的具体缺口,对关注自主AI系统防护措施的人士具有重要意义。

For three weeks, from July 21st to August 11th,1 a METR employee and a Redwood Research employee conducted a pilot high-access exercise to stress-test OpenAI’s internal misalignment monitoring system.2 The output of this exercise was a 61-page internal report that was shared with OpenAI researchers and security staff,3 primarily focused on estimating the fraction of agentic inference that is monitored, and whether agents could in principle disable or subvert the monitoring system. The exercise focused on the internal misalignment monitoring system as it existed on and before July 21st, and did not evaluate changes that were in progress at the time of the exercise.

This exercise involved a deep level of access. The METR and Redwood employees had access to OpenAI’s internal codebase, misalignment-monitor prompts / configuration details, and internal documentation, and conducted technical interviews with approximately a dozen researchers and engineers across the monitoring, safety-systems, and security teams. To enable this level of access, they worked on OpenAI-issued devices, which never left the premises, and were accompanied while onsite.

METR, Redwood Research, and OpenAI designed this exercise as a pilot for giving external researchers deep access to internal infrastructure, not to provide robust public transparency about OpenAI’s monitoring systems.4 As a result, we agreed upfront with OpenAI that we would only publish a relatively brief and high-level public post. For future versions of this exercise we expect to follow the transparency and independence best practices described in “Our approach to working with AI companies” to provide more robust public transparency.

#OpenAI#METR#Redwood Research#Codex#Responses API

原文约 7 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。