AI推动形式化验证走向主流,但并非万能
文章认为,AI正推动形式化验证走向主流,并列举形式化验证初创公司增长、单个项目生成十亿行Rocq代码,以及Theorem与Anthropic、Harmonic开展软件和硬件验证等进展。作者同时提醒,经过形式化验证的系统仍可能存在缺陷,因为规格、模型、证明器、编译器和机器语义仍可能被信任或存在缺陷。他预测,机器生成证明将推动部分单线程程序的一阶性质在二进制层面得到验证,但并发、分布式、高阶和非功能性质仍需多年努力。
文章具体梳理了AI辅助形式化验证的实际进展与边界,说明“已形式化验证”为何不能直接等同于系统绝对正确。
AI is making formal verification go mainstream...
...I wrote in December 2025, well, after the last 12 months I believe it is hard to argue otherwise. AI has made formal verification go mainstream.
Not only did the number of formal verification startups skyrocket, Claude also wrote a billion lines of Rocq for a single verification project, everyone from the creator of Claude Code to the Vercel CEO, lead Codex/Cursor developers is talking about formal verification. The early startups have started to show economic value in software on top of simply producing math proofs: Theorem's binary verification work with Anthropic, Harmonic verifying C programs and hardware designs... With the cybersecurity risk going through the roof, formal verification is not just easier, it is also getting more economically valuable.
The questions people ask now are not "how can we prove X", but rather "what can we prove about X"; or "what is left that we can't prove"? These are good questions to ask, I am writing this post in part to answer them; and in part as a follow-up to last year's post "Test, don't (just) verify". To tease the ending, I am very optimistic about formal verification, but I think people mean lots of different things when they say something is "formally verified", which I will try to break down into the parts I'm optimistic and pessimistic about.
#Anthropic#Claude#Claude Code#Theorem#Harmonic#Google DeepMind#Signal#Rocq#Lean