创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Abundant用Modal构建强化学习rollout基础设施

AI 总结

Modal Blog称,Abundant使用Modal Sandboxes和Functions运行强化学习环境,供OpenAI、Anthropic、Google和Meta等前沿实验室训练与评估模型。该架构包含超过7.5万个rollout,覆盖GPU内核优化、长程编程等任务,并设有监控器、弹性资源扩展和任务验证器。Modal还称,Abundant每月运行超过200万个Sandbox,并为Frontier RSI基准提供超过1300小时的智能体研究计算。

深度见解

该案例披露了大规模强化学习环境的具体实现方式,但基础设施效率和客户使用情况主要来自供应商自述。

Abundant builds reinforcement learning environments that frontier labs like OpenAI, Anthropic, Google, and Meta use to train and evaluate their models. Labs improve agent capability by giving them difficult tasks that Abundant designs, letting the model attempt it, and grading the result as pass or fail.

Each task is an RL rollout with a full environment. The model needs instructions, a defined goal, and a verifier to decide whether the task was completed. But it also needs infrastructure: compute to power the run, Dockerfiles, and isolation. Depending on the task, an agent may even need accelerators like GPUs.

Abundant has created over 75,000 rollouts — ranging from GPU kernel optimization to long-horizon coding — each of which runs in a Modal Sandbox. Modal makes their rollout infrastructure easy to build and cost-efficient to run, enabling the Abundant team to focus on their core business.

Building a rollout platform on Modal

Today, almost all of Abundant’s rollout platform runs on Modal. Modal Functions power Abundant’s scheduler API to start tasks, clean up dead runs, and review rollouts. Modal Sandboxes power the rollout environments.

#Abundant#Modal#Frontier RSI#OpenAI#Anthropic#Google#Meta

原文约 4 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。