Coding Agents Build an FPGA-Based LLM Inference System
In a first-hand account, the project author says Codex and a cloud agent configured an AWS F2 FPGA instance to run an LLM using C++ and Verilog. The agent reportedly completed hundreds of experiments, improved speed by 33 times from the first bit-exact baseline, and reached about 220–230 tokens per second with an 8,192-token context. These performance figures and the broader claim that coding agents made the low-level hardware work feasible come from a single unverified source.
The detailed account demonstrates how coding agents may extend engineers into unfamiliar low-level hardware workflows, but its speed and capability claims have not been independently verified.
Or rather, I vibe-coded an FPGA into running an LLM. And it… just worked.
Friday. November 20, 2026
One of the more entertaining things about programming recently is that coding agents let me work in entirely new domains by giving me access to new programming languages and paradigms. Lately, that has meant hacking on hardware, now that writing low-level software is much easier. So, in this blog post, I’m going to try to recount the experience of vibe coding an FPGA, going through a series of “oh shit” moments several times, and giving myself a new appreciation for what’s possible if you have a large token budget (thanks YC) and interesting problems to point the models at.
I overheard some founders recently talk about how FPGAs work. I’ll admit I was relatively naive about them. I’d never really experimented with them in my startup or in college, so I knew little about them before. The basic idea I was familiar with: you can program a circuit into a reprogrammable chip. So rather than having a general purpose computing architecture (like a CPU) you can have a reprogrammable one, i.e. the configuration loaded onto the chip determines how its logic and routing are connected, and that (in theory) enables performance advantages. I also know that it took a mountain of C++ to write and involved manually analyzing waveforms for simulation and verification. I had never done this before though and it seemed cumbersome.