Hinton proposes FDA-style pre-approval for AI models before release
Geoffrey Hinton proposed on the Smart Girl Dumb Questions podcast that AI companies should have to prove a product's safety to regulators before it is released. Drawing on the pharmaceutical industry, he said a new drug cannot go to market without convincing the FDA, a process he estimated requires roughly a billion dollars of work, and argued AI should face at least the same requirement. A Huxiu commentary also rounds up his related remarks from a September 16 closed-door Capitol Hill briefing and an October 6 interview: developers would supply verifiable safety evidence to third-party and official reviewers, the window to build a regulatory system is only about one to two years, RLHF is merely cosmetic, and recursive self-improvement is a source of risk — while noting some of his judgments are his own speculation.
Under Hinton's proposal, developers would have to prove a model is safe to regulators before release, inverting the "launch first, fix later" approach that Huxiu describes as current practice.