SGLang

A model-serving system with optimized inference and scheduling capabilities.

The distinction that matters

Product capabilities and compatibility change. Check the linked project documentation before adopting or upgrading.

Reference definition