Skip to content
@sgl-project

sgl-project

Pinned Loading

  1. sglang sglang Public

    SGLang is a high-performance serving framework for large language models and multimodal models.

    Python 22.1k 3.9k

  2. sgl-learning-materials sgl-learning-materials Public

    Materials for learning SGLang

    706 51

  3. ome ome Public

    Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

    Go 351 52

  4. genai-bench genai-bench Public

    Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.

    Python 250 44

  5. SpecForge SpecForge Public

    Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

    Python 597 127

  6. sglang-jax sglang-jax Public

    JAX backend for SGL

    Python 205 50

Repositories

Showing 10 of 19 repositories
  • sglang Public

    SGLang is a high-performance serving framework for large language models and multimodal models.

    sgl-project/sglang’s past year of commit activity
    Python 22,053 Apache-2.0 3,916 660 (29 issues need help) 1,181 Updated Dec 31, 2025
  • ome Public

    Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

    sgl-project/ome’s past year of commit activity
    Go 351 Apache-2.0 52 32 (2 issues need help) 29 Updated Dec 31, 2025
  • sgl-cookbook Public

    Cookbook of SGLang - Recipe

    sgl-project/sgl-cookbook’s past year of commit activity
    JavaScript 48 Apache-2.0 9 5 5 Updated Dec 31, 2025
  • sgl-project.github.io Public

    This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang

    sgl-project/sgl-project.github.io’s past year of commit activity
    HTML 96 25 9 1 Updated Dec 31, 2025
  • sglang-jax Public

    JAX backend for SGL

    sgl-project/sglang-jax’s past year of commit activity
    Python 205 Apache-2.0 50 70 (6 issues need help) 19 Updated Dec 31, 2025
  • sgl-kernel-npu Public

    SGLang kernel library for NPU

    sgl-project/sgl-kernel-npu’s past year of commit activity
    C++ 91 MIT 68 13 30 Updated Dec 31, 2025
  • sgl-kernel-xpu Public

    SGLang kernel library for Intel XPU

    sgl-project/sgl-kernel-xpu’s past year of commit activity
    Python 15 MIT 13 0 18 Updated Dec 31, 2025
  • whl Public

    Kernel Library Wheel for SGLang

    sgl-project/whl’s past year of commit activity
    HTML 17 MIT 4 1 1 Updated Dec 31, 2025
  • mini-sglang Public

    A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

    sgl-project/mini-sglang’s past year of commit activity
    Python 2,699 262 8 11 Updated Dec 30, 2025
  • sgl-flash-attn Public Forked from Dao-AILab/flash-attention

    Fast and memory-efficient exact attention

    sgl-project/sgl-flash-attn’s past year of commit activity
    Python 15 BSD-3-Clause 2,272 0 1 Updated Dec 30, 2025