创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Together AI推出GPU集群存储加速器

AI 总结

Together AI推出Together Storage Accelerator(TSA),这是一款面向Together GPU Clusters的分布式缓存层,当前随每个集群免费提供。TSA在首次读取后会将对象缓存到集群NVMe,后续读取可从集群内部完成,并支持现有S3兼容存储和Hugging Face Hub工作流,无需新增SDK或重写数据加载器。Together AI测试显示,在H100节点上热缓存读取2 GiB Cloudflare R2对象耗时0.64至0.72秒,而未使用TSA时为12.7至15.0秒。

深度见解

TSA可能减少AI训练和推理集群的重复对象存储流量、延迟与出口费用,但公开的性能数据来自厂商自身测试。

Your GPUs are only as fast as your data pipelines. Every training run that starts with a 30-minute model download, every node that re-pulls the same dataset from across the country, and every Hugging Face rate limit that stalls a job leads to compute resources sitting idle, waiting for your data, while you are paying for them.

Today we're launching Together Storage Accelerator (TSA), a distributed caching layer for Together GPU Clusters that alleviates the need for repeated data reads from object storage and Hugging Face Hub, dramatically accelerating your AI data pipelines while also cutting your data egress bills. TSA is now included free with every Together GPU Cluster.

The problem: your data lives far from your GPUs

Most AI teams keep their source of truth in object storage (Amazon S3, Cloudflare R2, Together AI's T4*) or pull models directly from Hugging Face Hub. That means every cold start pays a WAN tax: cross-cloud or cross-region reads are slow, expensive (egress from AWS runs up to $0.09/GB), and rate-limited. Multiplied across hundreds of nodes pulling the same checkpoint, the waste compounds and costs you time, money, and failed jobs when the origin throttles you.

#Together AI#Together Storage Accelerator#Together GPU Clusters#ASTRA#T4#Hugging Face Hub#Cloudflare R2#NVIDIA H100

原文约 4 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。