Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

SwarmEvolve speeds program search with latent-space agent swarms

AI summary

SwarmEvolve is a Brown University framework for mathematical discovery and optimization that runs hundreds of low-cost agents reasoning in latent space and sharing information through KV caches. In the paper, it achieved the highest average score across 21 mathematical-discovery and scientific-computing problems and reached the baselines’ one-hour results in a median of three to eight minutes. The experiments used Qwen3 8B, 14B and 32B, with the authors also reporting improvements over AlphaEvolve on three problems when using Qwen3 8B.

In-depth insight

The paper presents latent-space communication and high agent concurrency as a way to increase the throughput of LLM-guided program search on a single GPU, although the reported benchmark results come from the authors’ experiments.

Last year Google DeepMind's AlphaEvolve found a faster way to multiply 4x4 complex matrices, beating a record that had stood since 1969. The idea is to let an LLM write a program, score it, and iteratively improve it. So it's called "evolve".

But AlphaEvolve runs on Gemini models. Similar open-source implementations are also usually slow and expensive. We tried to make it faster, cheaper, and better.

SwarmEvolve is our new paper, a scalable framework for math discovery and optimization.

We run swarms of hundreds of latent-reasoning agents on Qwen3 8B, 14B and 32B. In ~5 minutes, they reach scores that took OpenEvolve, ShinkaEvolve and CodeEvolve >1 hour.

Here's how:

  • Inspired by recent works in LatentMAS, our agents never write out their thoughts. They reason in latent space and pass KV caches to each other, so ideas from different agents mix right inside the model. This massively improved throughput.
  • Small agents are cheap, so we can run a lot of them, each with a different focus, organized in swarms. More agents means more diverse ideas each round, more exploration of the solution space, and the swarm finds good programs much faster.
  • It works at every model size we tried. With just the 8B model, it even matched the best known circle packing. Framework has been extended to work with Qwen3.5 and Muse models as well, showing even better performance.

Paper: https://www.alphaxiv.org/abs/2611.08483

Code (available soon): https://github.com/Qile-J/SwarmEvolve

Let me know if this makes sense or not. Also I'm really interested in apply such "evolve" frameworks on real scientific discovery problems - material science, biology, etc - so if anyone has any ideas for next steps / collaboration, I'm open to hear about it!

submitted by /u/QileHQ [link] [comments]

#SwarmEvolve#Brown University#Qwen3 8B#Qwen3 14B#Qwen3 32B#Qwen3.5#Muse#AlphaEvolve#OpenEvolve#ShinkaEvolve#CodeEvolve#LatentMAS

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.