创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Together AI推出多态推理与编译器

AI 总结

Together AI 发布了“多态推理”方法,旨在让推理系统适应不断变化的模型、工作负载和硬件。公司还推出 Together Compiler,并称其驱动的持续编译优化循环已用于多个生产推理工作负载。报告中的性能主张尚未经过独立验证。

深度见解

Together AI 表示,Together Compiler 通过多个 AI 智能体搜索性能优化方案,以应对开放权重模型架构和部署环境日益多样化的挑战。

Summary

At Together AI, we focus on making AI abundantly available to every individual user and organization. Our research team – the researchers behind FlashAttention, ThunderKittens, ThunderAgent, and more – has been a key driver behind our inference excellence. As the inference market grows exponentially, we’ve been focusing on how to scale our research capacity to enable abundant intelligence for all.

This has required a shift in our thinking from Static Inference to Polymorphic Inference – which is our response to the velocity of new model releases, diversity of model architectures, fast-changing workloads, and fast-changing hardware platforms. In this blog, we’ll highlight our research agenda for the Polymorphic Inference era – and how we are continuously using AI agents to optimize their own inference with Continuous Compilation.

‍

What is Polymorphic Inference?

Over the past year, there has been a marked step change in the diversity of open-source models and the ways that these models are deployed in production environments. We see this step change as requiring a new approach that we call Polymorphic Inference.

#Together AI#Together Compiler#Polymorphic Inference#ThunderAgent Router#TogetherLink

原文约 8 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。