What is lmdeploy built with?
lmdeploy is a Python repo built with FastAPI, Ray, AIOHTTP, and uvicorn. It uses AI through apache-tvm-ffi, flash-linear-attention, openai-harmony, partial-json-parser, qwen-vl-utils, and 18 more, makes its content with markdown, myst-parser, and pillow, validates its data with Pydantic, is tested with allure-pytest, pytest-cov, pytest-order, pytest-rerunfailures, pytest-sugar, and 3 more, runs in production with prometheus-client, and uses pyzmq. It has 299,565 written lines, with 336 test files.
Read on November 17, 2026, at commit fc33f69. Read it as markdown
The card says what it's built with. Its whole map opens it up: every part of the code and how it connects to the rest.
Frontend
Styles 1
sphinx-book-theme
Interface 1
Backend
The base 1
FastAPI24 files
Data 1
- pyzmq3 files
AI 21
- torch426 files
xgrammar8 files
accelerate7 files
safetensors4 files
torchvision4 files
peft2 files
torch-npu2 files
timm1 file
apache-tvm-ffi
flash-linear-attention
partial-json-parser
rdkit
- transformers123 files
- triton50 files
- datasets1 file
- einops1 file
- sentencepiece1 file
- tiktoken1 file
- openai-harmony
- qwen-vl-utils
- transformers-stream-generator
Services 2
Other repos with a similar stack
Ordered by how much of its stack they share with lmdeploy, then by stars.
- hpcaitechColossalAI41.4k
Making large AI models cheaper, faster and more accessible
18 of 63 in commonCompare → - bojieliai-agent-book58.5k
《深入理解 AI Agent:设计原理与工程实践》(李博杰 著)开源主仓库:全书正文、编译版 PDF 与按章配套代码
17 of 63 in commonCompare →
Frequently asked questions
What language is lmdeploy written in?
What framework does lmdeploy use?
Does lmdeploy use AI?
What services does lmdeploy use?
Does lmdeploy have tests?
Which repos have a stack like lmdeploy's?
See inside your code, today.
Paste your repo and see it drawn, part by part: a medium one in under a minute.
Free, no account.Private repo? Sign in with GitHub
Is it your repo? Add its badge, keep it up to date or take it down →

