lmdeploy vs vllm
lmdeploy and vllm share 22 technologies: FastAPI, pyzmq, OpenAI, Ray, AIOHTTP, apache-tvm-ffi, openai-harmony, partial-json-parser, torch, transformers, triton, xgrammar, safetensors, torchvision, einops, sentencepiece, tiktoken, timm, markdown, pillow, Pydantic, and prometheus-client. Both are written in Python.
What they share and what sets them apart
lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
Python8.1kRead on November 17, 2026, at commit fc33f69What is lmdeploy built with?Only in lmdeploy
- Anthropic
uvicorn
sphinx-book-theme
matplotlib
flash-linear-attention
- qwen-vl-utils
rdkit
- transformers-stream-generator
accelerate
peft
torch-npu
- datasets
myst-parser
In common
FastAPI
- pyzmq
OpenAI- Ray
- AIOHTTP
apache-tvm-ffi
- openai-harmony
partial-json-parser
- torch
- transformers
- triton
xgrammar
safetensors
torchvision
- einops
- sentencepiece
- tiktoken
timm
- markdown
pillow
- Pydantic
prometheus-client
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Python97.1kRead on November 17, 2026, at commit 61c3895What is vllm built with?Only in vllm
- axum
- gitdb
- Hugging Face
- Tokio
starlette
- tower
mkdocs-material
- indicatif
- AMD
- auto-round-lib
- conch-triton-kernels
- cuda-bindings
- cuda-python
cupy-cuda12x
cupy-cuda13x
flashinfer-python
- humming-kernels
lm-format-enforcer
mooncake-transfer-engine
mooncake-transfer-engine-rocm
NVIDIA
nvidia-cudnn-frontend
- oss-harmony
- quack-kernels
- vllm-bench
- vllm-chat
- vllm-engine-core-client
- vllm-llm
- vllm-managed-engine
- vllm-parser
- vllm-proto
- vllm-server
- vllm-text
- vllm-tokenizer
- xgrammar-structural-tag
llm-multimodal
- compressed-tensors
- mistral-common
lmcache
torchaudio
vllm-xpu-kernels
- runai-model-streamer
tokenizers
tokenspeed-mla
- llguidance
- MCP
outlines-core
- tpu-inference
- fastokens
- fastsafetensors
- hf-hub
- instanttensor
- nixl
- riptoken
- tekken
- tensorizer
- tiktoken-rs
markupsafe
- mkdocs-material-extensions
parquet
- properdocs
- pymdown-extensions
selectolax
- xlsxwriter
- image
- jinja2
minijinja
- torchcodec
minijinja-contrib
- annotated-types
msgspec
validator
- opentelemetry-semantic-conventions-ai
- python-json-logger
- vllm-metrics
- vllm-tracing
tracing
psutil
tracing-futures
tracing-subscriber
- model-hosting-container-standards
OpenTelemetry
- prometheus-fastapi-instrumentator
tracing-log
Side by side
Frequently asked questions
Which is bigger, lmdeploy or vllm?
The proof: vllm-project/vllm's code at commit 61c3895
Which has more GitHub stars, lmdeploy or vllm?
The proof: vllm-project/vllm on GitHub
Which has more tests, lmdeploy or vllm?
The proof: vllm-project/vllm's code at commit 61c3895
Which was updated more recently, lmdeploy or vllm?
The proof: InternLM/lmdeploy's commits on GitHub
Which has more commits signed by AI, lmdeploy or vllm?
The proof: the commits each tool signed in vllm-project/vllm
See inside your code, today.
Paste your repo and see it drawn, part by part: a medium one in under a minute.
Free, no account.Private repo? Sign in with GitHub

