Miles Runs Agentic RL Training on NVIDIA Vera CPUs
RadixArk partnered with NVIDIA to run its open-source Miles post-training framework end to end, with every isolated Firecracker sandbox hosted on NVIDIA Vera CPUs. The reported run trained GLM-4.7-Flash for 68 steps across more than 2,400 Terminal-Bench and SWE-bench episodes in synchronous and fully asynchronous modes; one gRPC task’s pass rate rose from 40% to 82% between training halves. RadixArk also compared Vera with AMD EPYC Turin and Intel Xeon 61 systems, reporting 12% faster episodes under tested busy-server conditions.
The report demonstrates that CPU sandbox throughput can materially affect large-scale agentic RL training, while providing concrete training and comparison data for infrastructure teams evaluating Vera.
On this page
- End-to-end training with every sandbox on Vera
- Episodes finish sooner in real RL training
- Vera stays fast at full load
- What this means for RL training
- Conclusion
In agentic RL, the model does more than write text: it runs commands in a sandbox, compiles code and runs tests, and decides its next step from the results. A training run can keep hundreds of sandboxes or more open at once, and the CPUs that run them can affect the speed and scale of training.
RadixArk partnered with NVIDIA to run Miles, our open-source RL post-training framework for LLMs and VLMs, with every sandbox on NVIDIA Vera CPUs. To our knowledge, this is the first public result of end-to-end agentic RL training with its sandboxes on Vera CPU servers. We also compared Vera systematically with the current-generation AMD EPYC Turin and Intel Xeon 61. The conclusion is clear: Vera runs sandboxes fast even at full load, and its advantage grows as training gets larger and inference gets faster.
#Miles#NVIDIA Vera#RadixArk#GLM-4.7-Flash#AgentENV#Firecracker#SGLang#AMD EPYC Turin#Intel Xeon 61#Terminal-Bench#SWE-bench#NVIDIA