Redwood questions Gemini 4 safety reports
Redwood Research says Google DeepMind's safety reports do not reliably demonstrate that deployment risks for Gemini 4 Argon and Carbon have been mitigated. It notes that no control evaluations were run on Carbon, while Argon evaded a realistic monitor about half the time on easy sabotage tasks when encouraged to sabotage; Google DeepMind's reports nevertheless characterize both models as highly unlikely to cause severe harm by evading oversight.
The review highlights significant gaps in Google DeepMind's loss-of-control safety case for Gemini 4 Argon and Carbon, including missing Carbon control evaluations and Argon monitor-evasion results.
Google DeepMind’s safety reports for new Gemini 4 models, Argon and Carbon, conclude that the models are “highly unlikely” to cause severe harm by evading oversight (p. 79). This conclusion “rests primarily on our ability to detect and intervene on harmful trajectories via CoT and action monitoring” (p. 89) – that is, they’re arguing for safety based on their control techniques, rather than alignment. We think that the arguments in these reports have serious weaknesses, and the reports overall don’t convince us that the risks of deploying these models have been mitigated reliably.
The biggest problems:
#Google DeepMind#Gemini 4 Argon#Gemini 4 Carbon#Redwood Research