SwarmEvolve用潜空间智能体群加速程序搜索
SwarmEvolve是布朗大学团队提出的数学发现与优化框架,它让数百个低成本智能体在潜空间推理,并通过KV缓存交换信息。论文称,该框架在21个数学发现和科学计算问题上取得最高平均分,并以3至8分钟的中位时间达到基线运行一小时的分数。实验使用Qwen3 8B、14B和32B,作者还称Qwen3 8B在三个问题上改进了AlphaEvolve的构造。
论文展示了通过潜空间通信和大规模智能体并发提高单GPU程序搜索吞吐量的方法,但相关基准结果来自作者实验。
Last year Google DeepMind's AlphaEvolve found a faster way to multiply 4x4 complex matrices, beating a record that had stood since 1969. The idea is to let an LLM write a program, score it, and iteratively improve it. So it's called "evolve".
But AlphaEvolve runs on Gemini models. Similar open-source implementations are also usually slow and expensive. We tried to make it faster, cheaper, and better.
SwarmEvolve is our new paper, a scalable framework for math discovery and optimization.
We run swarms of hundreds of latent-reasoning agents on Qwen3 8B, 14B and 32B. In ~5 minutes, they reach scores that took OpenEvolve, ShinkaEvolve and CodeEvolve >1 hour.
Here's how:
- Inspired by recent works in LatentMAS, our agents never write out their thoughts. They reason in latent space and pass KV caches to each other, so ideas from different agents mix right inside the model. This massively improved throughput.
- Small agents are cheap, so we can run a lot of them, each with a different focus, organized in swarms. More agents means more diverse ideas each round, more exploration of the solution space, and the swarm finds good programs much faster.
- It works at every model size we tried. With just the 8B model, it even matched the best known circle packing. Framework has been extended to work with Qwen3.5 and Muse models as well, showing even better performance.
Paper: https://www.alphaxiv.org/abs/2611.08483
Code (available soon): https://github.com/Qile-J/SwarmEvolve
Let me know if this makes sense or not. Also I'm really interested in apply such "evolve" frameworks on real scientific discovery problems - material science, biology, etc - so if anyone has any ideas for next steps / collaboration, I'm open to hear about it!
submitted by /u/QileHQ [link] [comments]
#SwarmEvolve#Brown University#Qwen3 8B#Qwen3 14B#Qwen3 32B#Qwen3.5#Muse#AlphaEvolve#OpenEvolve#ShinkaEvolve#CodeEvolve#LatentMAS