创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Modal发布开源Spindle训练服务器

AI 总结

Modal发布开源训练服务器Spindle,兼容Thinking Machines的Tinker API,并运行在用户的Modal工作区中。它支持对开放模型进行全参数训练和multi-LoRA,用户可以控制服务器并按GPU时间而非token计费。Modal称,其默认配置旨在最大化GPU利用率,Spindle可支持数百个并发训练运行,并达到与闭源API相近的性能和更低的成本;该产品目前仍处于测试阶段。

深度见解

Spindle为开展后训练和强化学习实验的团队提供了另一种Tinker兼容训练接口实现,并支持在Modal基础设施上定制服务器及按GPU时间计费。

Thinking Machines’ Tinker changed how people do post-training. You write the training loop in plain Python on your laptop, and Tinker runs the forward and backward passes on its GPUs. We’re big fans, and so are many of the teams we work with.

As those teams scale up, however, they keep raising the same two problems:

  • Per-token pricing gets expensive once you’re running dozens of experiments.
  • You can only use the models and features the provider decides to support.

We think a good API deserves more than one implementation. Today we’re releasing Spindle, an open-source, Tinker-compatible training server that runs in your Modal workspace. Because you own the server, you can customize anything in it, and you pay for GPU time instead of tokens. Our default configs are tuned to maximize GPU utilization out of the box, and we plan to keep shipping optimizations to push price-performance further.

All it takes is a single command to deploy a server:

spindle deploy

#Modal#Spindle#Tinker#Thinking Machines#Modal Dojo#Miles#SGLang#GPT-OSS-20B#Qwen3.5-9B

原文约 6 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。