Together AI推出GPU集群存储加速器
Together AI推出Together Storage Accelerator(TSA),这是一款面向Together GPU Clusters的分布式缓存层,当前随每个集群免费提供。TSA在首次读取后会将对象缓存到集群NVMe,后续读取可从集群内部完成,并支持现有S3兼容存储和Hugging Face Hub工作流,无需新增SDK或重写数据加载器。Together AI测试显示,在H100节点上热缓存读取2 GiB Cloudflare R2对象耗时0.64至0.72秒,而未使用TSA时为12.7至15.0秒。
TSA可能减少AI训练和推理集群的重复对象存储流量、延迟与出口费用,但公开的性能数据来自厂商自身测试。
Your GPUs are only as fast as your data pipelines. Every training run that starts with a 30-minute model download, every node that re-pulls the same dataset from across the country, and every Hugging Face rate limit that stalls a job leads to compute resources sitting idle, waiting for your data, while you are paying for them.
Today we're launching Together Storage Accelerator (TSA), a distributed caching layer for Together GPU Clusters that alleviates the need for repeated data reads from object storage and Hugging Face Hub, dramatically accelerating your AI data pipelines while also cutting your data egress bills. TSA is now included free with every Together GPU Cluster.
The problem: your data lives far from your GPUs
Most AI teams keep their source of truth in object storage (Amazon S3, Cloudflare R2, Together AI's T4*) or pull models directly from Hugging Face Hub. That means every cold start pays a WAN tax: cross-cloud or cross-region reads are slow, expensive (egress from AWS runs up to $0.09/GB), and rate-limited. Multiplied across hundreds of nodes pulling the same checkpoint, the waste compounds and costs you time, money, and failed jobs when the origin throttles you.
#Together AI#Together Storage Accelerator#Together GPU Clusters#ASTRA#T4#Hugging Face Hub#Cloudflare R2#NVIDIA H100