A commentary says Anthropic researcher Jacob Coxon resigned after warning that Anthropic and OpenAI were racing toward self-improving superintelligence and “gambling with our lives.” Anthropic’s head of alignment science, Evan Hubinger, said Coxon was correct that AI could kill all humans, while CEO Dario Amodei told CNN that he agreed with Coxon more than he disagreed with him. The commentary argues that recursive self-improvement remains speculative and that pursuing it could produce systems that are harder for humans to understand and control, even without an intelligence explosion.
A coding agent can fix a program, yet the next time it encounters an error, it may still follow the same process of debugging, editing, and testing. The task outcome may have changed, but the method that produced it may not have. When the bottleneck lies precisely in that method, who is responsible for improving the program responsible for improvement?
Gödel Machine (GM) [1] framed this as a proo…
AI has already entered code writing, algorithm optimization, and model development. But after a task is completed, what remains may be reusable capability—or merely an answer and scattered logs. The difference becomes apparent only when a similar problem comes up again: can the system reuse what it learned, or must it pay the cost of exploration all over again?
Recursive Self-Improvement (RSI) co…