OpenAI与FMF推出网络越狱评级框架
OpenAI与Frontier Model Forum宣布联合推出新框架,用于识别可能绕过AI安全措施并造成严重危害的网络越狱,消息来自OpenAI。该框架提供统一方法,根据越狱所启用的能力及使用难度比较严重程度,以帮助确定更优先的防护改进。
OpenAI表示,共享方法可帮助AI与安全社区建立更清晰的证据基础,并确定安全防护改进的优先级。
We partnered with @fmf_org and its member firms on a new framework to help identify when bypassing an AI system's safeguards could enable serious cyber harm, and prioritize stronger protections.
"...This framework is an important step toward a common methodology for evaluating and comparing the severity of cyber jailbreaks, including the capabilities they unlock and how readily they can be used. Shared approaches like this can help the AI and security communities build a clearer evidence base and prioritize improvements to safeguards." - OpenAI's Sasha Baker, Head of National Security Policy
https://www.frontiermodelforum.org/updates/introducing-the-fmf-jailbreak-rating-framework-for-frontier-cyber-threats/