xAI reportedly rewrites RL and inference stack in C/C++
InfoQ reports that Elon Musk said xAI will abandon JAX and SGLang and rewrite its reinforcement learning and inference stack from scratch in C/C++. The report also presents Oxide co-founder Bryan Cantrill’s argument that Rust can improve memory safety and give AI coding tools useful compiler feedback, but cannot prevent LLMs from continually adding system complexity.
The reported rewrite is a significant infrastructure decision for an AI company, while the accompanying Rust discussion highlights the trade-offs between performance, memory management and AI-assisted development.

“真男人自己管理内存。”
11 月 10 日,面对网友“为什么用 C/C++ 重写,之前用的是 Rust 吗”的追问,Elon Musk 用这句话回应了 xAI 的技术选择。
四年前,他还公开表示自己是 Rust 的拥趸,认为 Discord 的实践证明了它的扩展能力。不过,他当时也保留了一个判断:在专用硬件上追求极致性能,精炼的 C 代码配合定制编译器,依然无可匹敌。

如今,随着他宣布弃用 JAX/SGLang、用 C/C++ 从零重写强化学习与推理技术栈,这场关于性能、内存管理和语言选择的争论,又被推到了台前。