Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

LMSYS Org launches SGLang Consortium with eight founding members

AI summary

LMSYS Org launched the SGLang Consortium during the opening keynote of the inaugural SGLang Summit in San Francisco, with NVIDIA, AMD, Intel, Google, Meta, Cloudflare, Modal and RadixArk as founding members. Members will assign technical representatives and attend two roadmap meetings annually, contributing engineering expertise, deployment feedback, testing resources or joint development, while SGLang maintainers retain authority over technical decisions and code acceptance. The stated priorities include frontier-model support, reasoning and multimodal workloads, distributed inference and hardware optimization.

In-depth insight

The consortium gives major hardware, model and infrastructure providers a standing forum to coordinate engineering work with SGLang maintainers, making it a significant development for open-source AI inference.

Hardware, model and infrastructure leaders join SGLang’s maintainers to advance efficient inference for growing AI ecosystem

SGLang Consortium founding members, including Thinking Machines Lab, and LMSYS Org

LMSYS Org, the nonprofit behind the open-source AI engine SGLang, launched the SGLang Consortium on November 12, 2026. The consortium’s founding members now include NVIDIA, AMD, Intel, Google, Meta, Thinking Machines Lab, Cloudflare, Modal and RadixArk, who will work with SGLang’s maintainers to help shape the project’s roadmap and advance open-source AI inference. The consortium was announced in the opening keynote of the inaugural SGLang Summit in San Francisco.

A shared forum for open AI inference

Inference is expected to account for roughly two-thirds of all AI compute in 2026, up from about half in 2025, according to Deloitte. The inference engine determines how fast and cost-effectively that compute runs on each company’s hardware. SGLang, the full-stack inference engine for frontier AI and part of the PyTorch ecosystem, runs on hundreds of thousands of GPUs and powers some of the largest production inference deployments in the world, for companies including Meta, Microsoft, Google, Amazon, Thinking Machines Lab, Cloudflare, Reflection and Modal.

#LMSYS Org#SGLang#SGLang Consortium#NVIDIA#AMD#Intel#Google#Meta#Cloudflare#Modal#RadixArk#SGLang Summit

Original · 3 min readRead the original
Group chat

No comments yet. Start the conversation.