sgl-project/sglang-omni
High Performance Serving Runtime For Interactive Super Intelligence System
A SGLang spin-off dedicated to serving speech and omni models — Built on the SGLang project, SGLang-Omni focuses on serving TTS, ASR and unified multimodal models with OpenAI-compatible APIs, streaming and distributed inference on CUDA. Useful for teams who need production-grade speech and multimodal serving without building custom inference stacks.
LLMs & MLasraudio-generationcudadistributed-inferenceinferenceinteractivemodel-servingmultimodalmusic-generationopenai-apipytorchsglangspeech-recognitionstreamingtext-to-speechtts
Metrics
Relative growth (7d)+4%Growth over the last 7 days relative to size
Acceleration-31%Change in growth pace from the week before
Attention47The three metrics scaled to 0–100 and combined
Retention can be computed 30 days after a repository first trends (it isn't shown until then). See About for how each metric is defined.
Star growth and Trending appearances (last 30 days)
First listed+54★/dayDaily
Sep 30, 2026Oct 29, 2026
Bands mark days on the trending list (darker = higher rank)
Daily trending ranks as a table (2 days)
| Date | Daily |
|---|---|
| Oct 16, 2026 | python #12 +30 |
| Oct 14, 2026 | python #10 +29 |
Created Jan 7, 2026 · First on trending Oct 14, 2026
Other notable repositories in the same category (LLMs & ML)
- pst2154/nemotron-deciffusion
- todesking/slopsampler
- datalab-to/indra
- fudan-generative-vision/Remory
- google-pytorch/torch_tpu
See all LLMs & ML repositories →
Rank within cuda
| # | Repository | ★ |
|---|---|---|
| 1 | vllm-project/vllm | 95,796 |
| 2 | debpalash/VoiceStudio | 93,095 |
| 3 | jamiepine/voicebox | 58,916 |
| 4 | sgl-project/sglang | 38,326 |
| 5 | bendlang/bend | 24,520 |
| 6 | tracel-ai/burn | 16,192 |
| 7 | vosen/ZLUDA | 15,148 |
| 8 | NVIDIA/TensorRT-LLM | 14,969 |
| 9 | NVIDIA/cuda-rust | 3,859 |
| 10 | mw00/project-maya | 2,157 |
| 13 | sgl-project/sglang-omni | 1,646 |