LMSYS Org launches SGLang Consortium with NVIDIA, AMD, Google and Meta

LMSYS Org, the nonprofit behind the open-source inference engine SGLang, has launched the SGLang Consortium with NVIDIA, AMD, Intel, Google, Meta, Cloudflare, Modal and RadixArk as founding members, LMSYS Org announced. It was presented in the opening keynote of the first SGLang Summit in San Francisco, held 12 and 13 November.

An inference engine is the software that runs a trained model and answers requests. LMSYS Org says SGLang runs on hundreds of thousands of GPUs and is used in production by companies including Meta, Microsoft, Google, Amazon, Thinking Machines Lab, Cloudflare, Reflection and Modal.

Each founding member names a technical representative and joins two roadmap meetings a year. Members can contribute engineering work, deployment feedback, testing resources or joint development, with a focus on support for frontier models, reasoning and multimodal workloads, distributed inference and hardware optimization. SGLang's maintainers keep the final say on technical decisions and on which code is accepted, and the project stays open to everyone.

"Better software helps developers get more performance from NVIDIA compute," said Ian Buck, vice president of hyperscale and high-performance computing at NVIDIA. LMSYS Org cites a Deloitte estimate that inference will take roughly two-thirds of all AI compute in 2026, up from about half in 2025.