What is lmdeploy built with?

lmdeploy is a Python repo built with FastAPI, Ray, AIOHTTP, and uvicorn. It uses AI through apache-tvm-ffi, flash-linear-attention, openai-harmony, partial-json-parser, qwen-vl-utils, and 18 more, makes its content with markdown, myst-parser, and pillow, validates its data with Pydantic, is tested with allure-pytest, pytest-cov, pytest-order, pytest-rerunfailures, pytest-sugar, and 3 more, runs in production with prometheus-client, and uses pyzmq. It has 299,565 written lines, with 336 test files.

Read on November 17, 2026, at commit fc33f69. Read it as markdown

The card says what it's built with. Its whole map opens it up: every part of the code and how it connects to the rest.

Frontend

Styles 1

  • sphinx-book-theme

Interface 1

Backend

The base 1

Data 1

AI 21

9 more

Services 2

Support

The base 3

Content 3

Validation 1

Testing 8

  • Pytest260 files
  • pytest-cov
  • pytest-order
  • pytest-rerunfailures
  • pytest-xdist
  • jsonschema6 files
  • allure-pytest
  • pytest-sugar

Deploy 1

Tools 11

  • coverage1 file
  • pybind11
  • Setuptools
  • Sphinx
  • sphinx-autodoc-typehints
  • sphinxcontrib-openapi
  • fire9 files
  • tilelang8 files
  • sphinx-copybutton
  • sphinx-tabs
  • sphinxcontrib-mermaid

Other 9

  • NumPy55 files
  • pyyaml2 files
  • opencv-python-headless1 file
  • urllib31 file
  • nvidia-ml-py
  • shortuuid11 files
  • pybase645 files
  • cloudpickle1 file
  • protobuf

Other repos with a similar stack

Ordered by how much of its stack they share with lmdeploy, then by stars.

Frequently asked questions

What language is lmdeploy written in?
lmdeploy is written in Python, with 299,565 written lines.
What framework does lmdeploy use?
lmdeploy is built with FastAPI, Ray, AIOHTTP, and uvicorn.
Does lmdeploy use AI?
Yes. lmdeploy uses AI through apache-tvm-ffi, flash-linear-attention, openai-harmony, partial-json-parser, qwen-vl-utils, rdkit, transformers-stream-generator, torch, transformers, triton, xgrammar, accelerate, safetensors, torchvision, peft, torch-npu, datasets, einops, sentencepiece, tiktoken, timm, Anthropic, and OpenAI.
What services does lmdeploy use?
lmdeploy uses pyzmq.
Does lmdeploy have tests?
Yes. lmdeploy has 336 test files and is tested with allure-pytest, pytest-cov, pytest-order, pytest-rerunfailures, pytest-sugar, pytest-xdist, Pytest, and jsonschema.
Which repos have a stack like lmdeploy's?
The ones that share most of its stack:vllm-project/vllmray-project/raysgl-project/sglang

See inside your code, today.

Paste your repo and see it drawn, part by part: a medium one in under a minute.

Free, no account.Private repo? Sign in with GitHub

Or look inside SeeRepo's own →

Is it your repo? Add its badge, keep it up to date or take it down →