Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Agent refactors 300K lines of C in three weeks, Code Health 5.6 to 10.0

AI summary

CodeScene published a case study in which a coding agent refactored a 300,000-line C codebase in three weeks for about $4,000 in tokens, making 2,903 commits across 726 files, changing 252,055 lines and raising the repo's Code Health score from 5.6 to 10.0. The code is an open-source decompilation project for Street Fighter III: 3rd Strike; the agent used the CodeHealth MCP Server's deterministic score and a replay-trajectory harness comparing state hashes frame by frame, and built a playbook of 22 transformations and 82 notes. CodeScene founder Adam Tornhill called it the first large-scale superhuman AI performance he had seen; the team mostly used Claude Opus with Claude Code, saying it beat Codex with Sol at spotting emerging patterns. Commenters split over what it proves: supporters said frame-by-frame replay is a higher bar than passing tests, while critics asked about scope, merges, unmeasured performance and model-tuned harness bias. A follow-up study with Lund University will have students add features to both the 5.6 and 10.0 versions; projections of ~70% fewer AI defects and ~45% less token waste came from earlier research.

In-depth insight

The case suggests agentic large-scale refactoring depends heavily on deterministic quality scoring and equivalence checks, exactly what most legacy systems lack.

CodeScene 发布了一项案例研究":编码智能体在三周内重构了一个包含 30 万行 C 代码的代码库,token 成本约为 4000 美元。这项工作在 726 个文件中产生了 2903 次提交,修改了 252055 行代码,并将代码库的 Code Health 评分从 5.6 提升至 10.0。该代码库来自《街头霸王 III:三度冲击》的一个开源反编译项目。

CodeScene 创始人、《Your Code as a Crime Scene》作者 Adam Tornhill 写道,在参与大型系统开发 30 年后,这是他第一次看到他所谓的大规模超人类 AI 表现。

两项机制支撑了这项工作。第一项是质量信号:CodeHealth MCP Server" 为智能体提供了一个可供优化的确定性评分,并用于判断一次转换是否产生了积极效果。第二项是正确性保障:一个回放轨迹测试框架逐帧比较回滚状态哈希,从而在每次更改后检查系统行为。

#CodeScene#Claude Code#Claude Opus#Codex#Sol#Code Health#CodeHealth MCP Server#Adam Tornhill#Lund University#Street Fighter III: 3rd Strike

Original · 5 min readRead the original
Group chat

No comments yet. Start the conversation.