Together Compiler
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 2
- Together AI launches agent-driven Together Compiler
Together AI introduced Together Compiler, an agent-driven framework for continual AI inference optimization that replaces hand-written megakernels with composable kernels, CUDA Graphs, PDL, and parallel agent workflows. The company said its internal experiments recovered 98% of megakernel performance with default Torch Inductor kernels plus CUDA Graphs and PDL, while later configurations achieved up to 1.7 times the throughput of its megakernel baseline. Together AI is offering early access and says the system produced 1,111 TPS on MiniMax M3.1-Flash and 1,205 TPS on DeepSeek v4.1-Flash.
Together AI Blog · 🔥 0 - Together AI unveils Polymorphic Inference and Together Compiler
Together AI introduced Polymorphic Inference, an approach designed to adapt inference systems to changing models, workloads, and hardware. It also announced Together Compiler, an AI-powered optimization loop that the company says powers Continuous Compilation across several production inference workloads. The reported performance benefits have not been independently validated.
Together AI Blog · 🔥 0
Experience and discussion from the community
Share my Together Compiler experienceAsk about Together Compiler
Nobody has shared their experience with Together Compiler yet.