Together AI推出多态推理与编译器
Together AI 发布了“多态推理”方法,旨在让推理系统适应不断变化的模型、工作负载和硬件。公司还推出 Together Compiler,并称其驱动的持续编译优化循环已用于多个生产推理工作负载。报告中的性能主张尚未经过独立验证。
Together AI 表示,Together Compiler 通过多个 AI 智能体搜索性能优化方案,以应对开放权重模型架构和部署环境日益多样化的挑战。
Summary
At Together AI, we focus on making AI abundantly available to every individual user and organization. Our research team – the researchers behind FlashAttention, ThunderKittens, ThunderAgent, and more – has been a key driver behind our inference excellence. As the inference market grows exponentially, we’ve been focusing on how to scale our research capacity to enable abundant intelligence for all.
This has required a shift in our thinking from Static Inference to Polymorphic Inference – which is our response to the velocity of new model releases, diversity of model architectures, fast-changing workloads, and fast-changing hardware platforms. In this blog, we’ll highlight our research agenda for the Polymorphic Inference era – and how we are continuously using AI agents to optimize their own inference with Continuous Compilation.
What is Polymorphic Inference?
Over the past year, there has been a marked step change in the diversity of open-source models and the ways that these models are deployed in production environments. We see this step change as requiring a new approach that we call Polymorphic Inference.
#Together AI#Together Compiler#Polymorphic Inference#ThunderAgent Router#TogetherLink