EveryDev.ai
Subscribe
Home
Developers

5,086+ AI companies

  • Radar
  • Trending
AI Tools by Topic
  • AI Coding Assistants
  • Agent Frameworks
  • MCP Servers
  • AI Prompt Tools
  • Vibe Coding Tools
  • AI Design Tools
  • AI Database Tools
  • AI Website Builders
  • AI Testing Tools
  • LLM Evaluations
Follow Us
  • X / Twitter
  • LinkedIn
  • Reddit
  • Discord
  • Threads
  • Bluesky
  • Mastodon
  • YouTube
  • GitHub
  • Instagram
Get Started
  • Users
  • Rate Tools
  • About
  • Editorial Standards
  • Corrections & Disclosures
  • Community Guidelines
  • Advertise
  • Contact Us
  • Newsletter
  • Submit a Tool
  • Start a Discussion
  • Write A Blog
  • Share A Build
  • Terms of Service
  • Privacy Policy
Explore with AI
  • ChatGPT
  • Gemini
  • Claude
  • Grok
  • Perplexity
Agent Experience
  • llms.txt
Theme
With AI, Everyone is a Dev. EveryDev.ai ©
    1. Home
    2. Developers
    3. SGLang Project

    SGLang Project

    SGLang is an open-source, high-performance serving framework for large language, vision-language, diffusion, and multimodal models. It aims to make production inference fast, scalable, low-latency, and accessible from a single GPU through distributed clusters.

    Visit Website

    At a Glance

    2Tools Listed
    4Products
    53Tool Views
    10Capabilities
    Discussions
    San Francisco, CaliforniaHeadquarters
    2023Est.
    50Employees
    $400MRaised
    Focus Areas
    Speech Recognition
    Voice Synthesis
    AI Infrastructure
    AI Development Libraries
    Connect
    Latest News
    Step 5 Preview: Day-0 Inference and RL Support with SGLang and MilesOct 14, 2026
    Fish Audio Drama 3 Meets SGLang Omni: Day-0 Support and the Stage–Process–GPU TopologyOct 13, 2026
    Markets
    • AI model developers and inference-platform teams
    • Startups and enterprises operating production AI services
    • Frontier-model companies and cloud providers
    • Research laboratories and universities
    • +1 more

    AI Tools by SGLang Project

    (2)
    View SGLang-Omni
    SGLang-Omni tool icon

    SGLang-Omni

    Open Source Omni Model Serving

    AI InfrastructureSpeech RecognitionVoice Synthesis
    View SGLang
    SGLang tool icon

    SGLang

    LLM and VLM Serving Framework

    Local InferenceAI InfrastructureAI Dev Libraries

    Discussions

    No discussions yet

    Be the first to start a discussion about SGLang Project

    Latest News

    10/14/2026

    Step 5 Preview: Day-0 Inference and RL Support with SGLang and Miles

    sglang.io
    10/13/2026

    Fish Audio Drama 3 Meets SGLang Omni: Day-0 Support and the Stage–Process–GPU Topology

    sglang.io
    09/23/2026

    Unified Radix Cache in SGLang: one tree for hybrid model prefix caching

    sglang.io
    09/20/2026

    RLinf x SGLang: Integrating Cosmos3 from Fine-Tuning to Efficient Parallel Evaluation

    sglang.io

    Products & Services

    4
    SGLang Runtime / SGLang
    2023

    Open-source Python-embedded structured-generation language and high-performance serving runtime for LLMs and multimodal models, distributed as the sglang package and via Docker.

    SGLang Diffusion
    2025-11

    Built-in image and video generation engine for diffusion workloads, supporting production-scale serving, parallelism, and optimized GPU execution.

    SGLang-Omni
    2026

    High-performance multi-stage serving runtime for omni, speech, TTS, ASR, music, and multimodal models, with OpenAI-compatible APIs and stage-specialized scheduling.

    SpecForge
    2025

    Open-source project in the SGLang GitHub organization for training speculative-decoding models and porting them to SGLang serving.

    Market Position

    SGLang competes with vLLM, TensorRT-LLM, Hugging Face TGI, DeepSpeed-Inference, LMDeploy, Guidance, and LMQL. It differentiates through a co-designed programming language/runtime, RadixAttention and broad prefix-cache reuse, fast constrained decoding, aggressive model/hardware day-0 support, and a unified stack spanning LLM, multimodal, diffusion, and speech serving.

    Leadership

    Founders

    YS

    Ying Sheng

    AI infrastructure and modeling researcher; the SGLang paper lists her with Stanford University, and later reporting identifies her as a key SGLang contributor and former xAI engineer and Databricks research scientist.

    IS

    Ion Stoica

    UC Berkeley professor and Databricks co-founder; SGLang originated in his UC Berkeley lab.

    JE

    Joseph E. Gonzalez

    UC Berkeley professor and machine-learning/systems researcher; co-author of the original SGLang paper.

    CK

    Christos Kozyrakis

    Stanford University professor and computer-systems researcher; co-author of the original SGLang paper.

    CH

    Cody Hao Yu

    Stanford-affiliated researcher and co-author of the original SGLang paper.

    SC

    Shiyi Cao

    UC Berkeley-affiliated researcher and co-author of the original SGLang paper.

    LZ

    Lianmin Zheng

    Researcher and first-listed author of the SGLang paper; a core contributor to the serving-runtime work.

    LY

    Liangsheng Yin

    Researcher and co-author of the original SGLang paper.

    ZX

    Zhiqiang Xie

    Researcher and co-author of the original SGLang paper.

    CS

    Chuyue Sun

    Researcher and co-author of the original SGLang paper.

    JH

    Jeff Huang

    Researcher and co-author of the original SGLang paper.

    Executive Team

    YS

    Ying Sheng

    SGLang co-creator and core maintainer; later co-founder and CEO of RadixArk

    Former xAI engineer and Databricks research scientist; key contributor to SGLang.

    IS

    Ion Stoica

    Academic originator / research sponsor

    UC Berkeley professor and Databricks co-founder; SGLang originated in his lab.

    Board of Directors

    IS
    Ion Stoica
    Co-founder and Executive Chairman
    LT
    Lip-Bu Tan
    Angel Investor and Advisor (Intel veteran)

    Founding Story

    SGLang began in 2023 as an open-source research project in Ion Stoica's UC Berkeley lab. The initial vision was to make complex multi-call language-model programs easier to express and execute efficiently, combining a Python-embedded structured-generation language with a co-designed runtime that reused KV caches and accelerated constrained decoding.

    Business Model

    Revenue Model

    SGLang is open-source Apache-2.0 software hosted by a nonprofit and is distributed for free through source, PyPI, Docker, and documentation. No SGLang-specific commercial subscription or usage-pricing model was identified; commercial managed infrastructure is associated with the separate RadixArk spinout.

    Pricing Tiers

    Open source
    $0

    Apache-2.0 licensed software available through GitHub, PyPI, Docker, and source builds.

    SGLang is an open-source nonprofit-hosted project rather than a standalone public company; no IPO plan was identified.

    Target Markets

    Industries & Segments
    • AI model developers and inference-platform teams
    • Startups and enterprises operating production AI services
    • Frontier-model companies and cloud providers
    • Research laboratories and universities
    • Teams building agentic, RL, multimodal, speech, and generative-media systems
    Use Cases
    • Large-scale production LLM inference
    • Agentic and multi-call language-model programs
    • Retrieval-augmented generation and multi-turn chat
    • Structured JSON/regex-constrained generation
    • Reinforcement-learning rollouts and evaluation
    • Vision-language, video, and multimodal inference
    Notable Customers
    • Google
    • Microsoft
    • NVIDIA
    • Oracle

    Quick Facts

    Headquarters
    San Francisco, California, United States
    Founded
    2023
    Entity Type
    Open-source project hosted by LMSYS Corp., a 501
    Employees
    50
    Total Funding
    Significant funding from Accel and prominent angels (Valuation ~$400M)
    Investors
    Accel, Lip-Bu Tan
    Office Locations
    3180 18th St

    Funding History

    AngelUndisclosed
    2025
    Lip-Bu Tan
    Venture RoundUndisclosed
    Jan 2026
    $400,000,000 valuation
    Accel

    History & Milestones

    October 2026

    SGLang announced day-0 Step 5 Preview inference and RL support with Miles and production serving support.

    September 2026

    SGLang and Miles announced day-0 support for DeepSeek-V4.1, including optimized kernels and serving support.

    September 2026

    SGLang published unified radix-cache work for hybrid prefix caching across GPU, host, and external tiers.

    September 2026

    SGLang and RLinf documented integration of Cosmos3 from fine-tuning through parallel evaluation.

    January 2026

    TechCrunch reported that part of the core-maintainer team spun out commercially as RadixArk while SGLang continued as an open-source project.

    Key Capabilities

    10
    RadixAttention and prefix/KV-cache reuse
    Continuous batching and zero-overhead scheduling
    Speculative decoding and multi-token prediction support
    Constrained/structured output decoding using compressed finite-state machines
    Disaggregated prefill/decode and data, tensor, pipeline, expert, and context parallelism
    Optimized CUDA, Triton, FlashInfer, and hardware-specific kernels

    Integrations & Partnerships

    Platform Integrations

    • Python package (sglang) and Docker images
    • OpenAI-compatible HTTP endpoints
    • Hugging Face model ecosystem
    • NVIDIA CUDA GPUs, AMD GPUs, Google TPU, Intel XPU/CPU, Ascend NPU, and Moore Threads MUSA
    • SGLang-Omni endpoints including /v1/chat/completions, /v1/audio/speech, /v1/audio/transcriptions, and /v1/audio/translations
    • Integrations with RLinf, Miles, DSPy, FlashInfer, Triton, and PyTorch

    Key Partnerships

    Hosted and incubated by LMSYS Corp., a nonprofit open-source organization
    SGLang and Miles collaboration for inference and reinforcement-learning support
    SGLang and RLinf integration for Cosmos3 fine-tuning and parallel evaluation

    Connect

    Website
    sglang.io
    GitHub
    sgl-project

    AI Topics

    5

    SGLang Project focuses on these topics:

    Speech Recognition(1)
    Voice Synthesis(1)
    AI Infrastructure(2)
    AI Development Libraries(1)
    Local Inference(1)
    Back to all developersSuggest an edit