Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

c/sglang_omni

sglang-omni0 membersJoin discussion
Project infosgl-project/sglang-omni

About

High Performance Serving Runtime For Interactive Super Intelligence System

Open sourceCreated November 11, 2026

Readme badge

Open-source project

Avatar from GitHubsgl-project/sglang-omniView on GitHub
Community-run · not official
Stars
1.8K
Forks
720
Language
Python
License
Apache-2.0

Last commit Nov 11, 2026

Daily rank, last 30 days

Not on the daily list in the last 30 days

sglang-omni: A multi-stage serving runtime for omni, speech, and TTS models.

What problem it solves Interactive multimodal and speech systems often require generation to span heterogeneous stages with different compute patterns, dependency structures, and resource needs. Serving these pipelines requires coordinated stage lifecycles, inter-stage transport, model integrations, and a unified API surface. Key features Coordinated multi-stage runtime — Models generation as coor…

github.comhttps://github.com/sgl-project/sglang-omni