OpenAI Internal Cyber Model Reportedly Scores 77% on ExploitGym
A Reddit analysis of a photo from OpenAI’s Cyber at the Frontier keynote listed an internal “Upcoming Cyber Model” at 77.0% on ExploitGym. The same report listed GPT-6 Cyber at 52.6%, GPT-6 Astra at 42.4%, and Claude Mythos 5.2 at 39.2% under a six-hour timeout. The figures are not a like-for-like comparison because Anthropic used wall-clock timeouts while OpenAI reported results across token budgets.
If the slide is accurately transcribed, the reported result indicates that OpenAI’s unreleased internal cyber model substantially exceeds the listed public and Anthropic model scores, though differences in harnesses limit the comparison.
| TLDR: I concluded two things: 1-OpenAI internal models are out-running Anthropic's. 2-OpenAI's internal models are a massive leap over public ones. The photo is from OpenAI’s Cyber at the Frontier keynote today(high res one). For context, ExploitGym tests whether an AI agent can take a real-world vulnerability and a crashing proof-of-concept input and turn it into a working end-to-end exploit across 869 containerized tasks. Here is how the current frontier stacks up: -OpenAI "Upcoming Cyber Model" (Internal): 77.0% -OpenAI GPT-6 Cyber: 52.6% (up from 48.5% at lower token budgets) -OpenAI GPT-6 Astra (Released in Sept): 42.4% -Claude Mythos 5.2 ( 6h timeout): 39.2% -Claude Mythos 5.2 (2h timeout): 38.1% -Claude Opus 5.5 (6h timeout): 34.5% -Claude Mythos 5.1 (6h timeout): 30.4% So, Anthropic’s brand-new flagship model—specifically with the safety classifiers relaxed for verified cyber teams—still hasn't caught up to base GPT-6 Astra from two months ago (39.2% vs. 42.4%). Meanwhile, OpenAI’s internal upcoming model is sitting at 77.0%. Even at ~30K average output tokens, that red line is already hovering around 70% before scaling up to 77.0% at ~75K tokens. Now, to be completely fair: Anthropic evaluates ExploitGym using wall-clock timeouts (2-hour and 6-hour runs in Claude Code), whereas OpenAI charts success rate across token budgets in their own harness. Harness differences always matter on agentic benchmarks. But a 38-percentage-point gap (77.0% vs 39.2%) I think goes way beyond harness tuning. To jump from ~52% to 77% on ExploitGym means the model is reliably cracking complex V8 browser sandboxes and multi-stage Linux kernel privilege escalations that no public model can touch. Between this and the internal math/reasoning runs we've been hearing about, it's wild how much headroom OpenAI is sitting on internally compared to what's actually released. submitted by /u/Electronic-Weekend66 [link] [comments] |
#OpenAI#Upcoming Cyber Model#GPT-6 Cyber#GPT-6 Astra#Anthropic#Claude Mythos 5.2#Claude Opus 5.5#ExploitGym