创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

OpenAI内部网络安全模型据报获ExploitGym 77%

AI 总结

一篇 Reddit 分析根据 OpenAI“Cyber at the Frontier”主题演讲照片称,内部“Upcoming Cyber Model”在 ExploitGym 上得分 77.0%。同一报告列出 GPT-6 Cyber 为 52.6%、GPT-6 Astra 为 42.4%,Claude Mythos 5.2 在六小时超时条件下为 39.2%。由于 Anthropic 采用墙钟超时,而 OpenAI 按令牌预算报告结果,这些数据并非完全同条件比较。

深度见解

如果幻灯片内容转录准确,OpenAI 尚未发布的内部网络安全模型得分将明显高于报告列出的公开模型和 Anthropic 模型,但测试环境差异限制了直接比较。

TLDR: I concluded two things: 1-OpenAI internal models are out-running Anthropic's. 2-OpenAI's internal models are a massive leap over public ones. The photo is from OpenAI’s Cyber at the Frontier keynote today(high res one). For context, ExploitGym tests whether an AI agent can take a real-world vulnerability and a crashing proof-of-concept input and turn it into a working end-to-end exploit across 869 containerized tasks. Here is how the current frontier stacks up: -OpenAI "Upcoming Cyber Model" (Internal): 77.0% -OpenAI GPT-6 Cyber: 52.6% (up from 48.5% at lower token budgets) -OpenAI GPT-6 Astra (Released in Sept): 42.4% -Claude Mythos 5.2 ( 6h timeout): 39.2% -Claude Mythos 5.2 (2h timeout): 38.1% -Claude Opus 5.5 (6h timeout): 34.5% -Claude Mythos 5.1 (6h timeout): 30.4% So, Anthropic’s brand-new flagship model—specifically with the safety classifiers relaxed for verified cyber teams—still hasn't caught up to base GPT-6 Astra from two months ago (39.2% vs. 42.4%). Meanwhile, OpenAI’s internal upcoming model is sitting at 77.0%. Even at ~30K average output tokens, that red line is already hovering around 70% before scaling up to 77.0% at ~75K tokens. Now, to be completely fair: Anthropic evaluates ExploitGym using wall-clock timeouts (2-hour and 6-hour runs in Claude Code), whereas OpenAI charts success rate across token budgets in their own harness. Harness differences always matter on agentic benchmarks. But a 38-percentage-point gap (77.0% vs 39.2%) I think goes way beyond harness tuning. To jump from ~52% to 77% on ExploitGym means the model is reliably cracking complex V8 browser sandboxes and multi-stage Linux kernel privilege escalations that no public model can touch. Between this and the internal math/reasoning runs we've been hearing about, it's wild how much headroom OpenAI is sitting on internally compared to what's actually released. submitted by /u/Electronic-Weekend66 [link] [comments]

#OpenAI#Upcoming Cyber Model#GPT-6 Cyber#GPT-6 Astra#Anthropic#Claude Mythos 5.2#Claude Opus 5.5#ExploitGym

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。