SwarmEvolve speeds program search with latent-space agent swarms
SwarmEvolve is a Brown University framework for mathematical discovery and optimization that runs hundreds of low-cost agents reasoning in latent space and sharing information through KV caches. In the paper, it achieved the highest average score across 21 mathematical-discovery and scientific-computing problems and reached the baselines’ one-hour results in a median of three to eight minutes. The experiments used Qwen3 8B, 14B and 32B, with the authors also reporting improvements over AlphaEvolve on three problems when using Qwen3 8B.
The paper presents latent-space communication and high agent concurrency as a way to increase the throughput of LLM-guided program search on a single GPU, although the reported benchmark results come from the authors’ experiments.
Last year Google DeepMind's AlphaEvolve found a faster way to multiply 4x4 complex matrices, beating a record that had stood since 1969. The idea is to let an LLM write a program, score it, and iteratively improve it. So it's called "evolve".
But AlphaEvolve runs on Gemini models. Similar open-source implementations are also usually slow and expensive. We tried to make it faster, cheaper, and better.
SwarmEvolve is our new paper, a scalable framework for math discovery and optimization.
We run swarms of hundreds of latent-reasoning agents on Qwen3 8B, 14B and 32B. In ~5 minutes, they reach scores that took OpenEvolve, ShinkaEvolve and CodeEvolve >1 hour.
Here's how:
- Inspired by recent works in LatentMAS, our agents never write out their thoughts. They reason in latent space and pass KV caches to each other, so ideas from different agents mix right inside the model. This massively improved throughput.
- Small agents are cheap, so we can run a lot of them, each with a different focus, organized in swarms. More agents means more diverse ideas each round, more exploration of the solution space, and the swarm finds good programs much faster.
- It works at every model size we tried. With just the 8B model, it even matched the best known circle packing. Framework has been extended to work with Qwen3.5 and Muse models as well, showing even better performance.
Paper: https://www.alphaxiv.org/abs/2611.08483
Code (available soon): https://github.com/Qile-J/SwarmEvolve
Let me know if this makes sense or not. Also I'm really interested in apply such "evolve" frameworks on real scientific discovery problems - material science, biology, etc - so if anyone has any ideas for next steps / collaboration, I'm open to hear about it!
submitted by /u/QileHQ [link] [comments]
#SwarmEvolve#Brown University#Qwen3 8B#Qwen3 14B#Qwen3 32B#Qwen3.5#Muse#AlphaEvolve#OpenEvolve#ShinkaEvolve#CodeEvolve#LatentMAS