Interconnects: expect rapid AI progress, but not general superintelligence
In a forward-looking essay, Interconnects' Nathan Lambert argues that the next few years of AI progress will be driven mainly by engineering and infrastructure efficiency rather than any change in the nature of models: training and inference metrics (tokens per second per GPU, cost per answer) are highly verifiable and optimizable, and agents should eventually optimize this stack end-to-end, pushing the effective cost of intelligence down near-exponentially. He expects pretraining research on architecture and data selection could be automated within 2–3 years, and cites Meta's Muse agent as an early sign of rising agentic demand as costs fall (a Jevons paradox effect). He stresses this path alone will not produce general superintelligence, with gains concentrated in math, coding and cross-field literature synthesis.
This framing helps explain why today's AI race increasingly hinges on engineering efficiency, falling costs and agent deployment rather than model capability alone.
I’ve often been surprised when I hear from top researchers in industry that they think AI will be better than them at their job in a few years, and I didn’t really know why I doubted it. The explanation I arrived at is that researchers are seeing this massive acceleration in the infra and engineering capabilities of the models. I fully agree that the models will be superhuman distributed GPU engineers in a few years. This will make experimentation and tinkering with the formulation of the models far easier, but it will not make our models dramatically different in nature.
In some ways, Ilya was early in his declaration of AI being in the era of research. Research is much easier today now that we have coding agents. This ease is through a different form of work that is flexible and engaging, which signals the start of an era where good ideas can be much more valuable than good execution in software.
We’re very early on this path. It’s also not the first transition the field has seen across the balance in if AI is more “research” or “engineering.” Before deep learning took off, AI was also far more of a research endeavor. Today, the best researchers are well-known to be judged by their ability to implement and scale their ideas in complex infrastructure. We’re about to go through a massive acceleration over a few years where the bottleneck is less and less engineering again. Some call this RSI, but a more grounded form is simply “parallelized, AI-assisted language modeling.” You don’t need to buy into takeoff scenarios to see just how much infrastructure improvements are coming, and how this’ll change the nature of working in AI.