llrt vs vllm
llrt and vllm share 8 technologies: Tokio, mkdocs-material, jinja2, markdown, markupsafe, mkdocs-material-extensions, pymdown-extensions, and tracing. llrt is written in Rust and vllm in Python.
What they share and what sets them apart
llrt
LLRT (Low Latency Runtime) is an experimental, lightweight JavaScript runtime designed to address the growing demand for fast and efficient Serverless applications.
Rust8.8kRead on November 16, 2026, at commit 5f62b24What is llrt built with?Only in llrt
In common
- Tokio
mkdocs-material
- jinja2
- markdown
markupsafe
- mkdocs-material-extensions
- pymdown-extensions
tracing
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Python96.8kRead on November 12, 2026, at commit c6573eeWhat is vllm built with?Only in vllm
- FastAPI
- axum
- gitdb
- pyzmq
- Hugging Face
starlette
- Ray
- AIOHTTP
- tower
- indicatif
- AMD
apache-tvm-ffi
- auto-round-lib
- conch-triton-kernels
- cuda-bindings
- cuda-python
cupy-cuda12x
cupy-cuda13x
flashinfer-python
- humming-kernels
lm-format-enforcer
mooncake-transfer-engine
mooncake-transfer-engine-rocm
- NVIDIA
nvidia-cudnn-frontend
OpenAI- openai-harmony
- oss-harmony
- quack-kernels
- sentencepiece
- vllm-bench
- vllm-chat
- vllm-engine-core-client
- vllm-llm
- vllm-managed-engine
- vllm-parser
- vllm-proto
- vllm-server
- vllm-text
- vllm-tokenizer
- torch
- transformers
- xgrammar-structural-tag
- einops
llm-multimodal
- compressed-tensors
safetensors
- triton
- mistral-common
xgrammar
partial-json-parser
torchvision
lmcache
torchaudio
timm
vllm-xpu-kernels
- runai-model-streamer
tokenizers
tokenspeed-mla
- llguidance
- MCP
outlines-core
- tpu-inference
- fastokens
- fastsafetensors
- hf-hub
- instanttensor
- nixl
- riptoken
- tekken
- tensorizer
- tiktoken
- tiktoken-rs
parquet
- properdocs
selectolax
- xlsxwriter
pillow
- image
minijinja
- torchcodec
minijinja-contrib
- annotated-types
- Pydantic
msgspec
- validator
- opentelemetry-semantic-conventions-ai
- python-json-logger
- vllm-metrics
- vllm-tracing
prometheus-client
psutil
tracing-subscriber
tracing-futures
- model-hosting-container-standards
- OpenTelemetry
- prometheus-fastapi-instrumentator
tracing-log
Side by side
Frequently asked questions
Which is bigger, llrt or vllm?
The proof: vllm-project/vllm's code at commit c6573ee
Which has more GitHub stars, llrt or vllm?
The proof: vllm-project/vllm on GitHub
Which has more tests, llrt or vllm?
The proof: vllm-project/vllm's code at commit c6573ee
Which was updated more recently, llrt or vllm?
The proof: awslabs/llrt's commits on GitHub
Which has more commits signed by AI, llrt or vllm?
The proof: the commits each tool signed in vllm-project/vllm
See inside your code, today.
Paste your repo and see it drawn, part by part: a medium one in under a minute.
Free, no account.Private repo? Sign in with GitHub

