SeeRepo
Draw my repo

TensorRT-LLM vs vllm

TensorRT-LLM and vllm share 28 technologies: FastAPI, pyzmq, OpenAI, starlette, NVIDIA, quack-kernels, sentencepiece, tiktoken, torch, triton, transformers, einops, safetensors, torchvision, datasets, MCP, peft, pillow, jinja2, Pydantic, msgspec, jsonschema, opentelemetry-api, psutil, prometheus-client, OpenTelemetry, opentelemetry-sdk, and prometheus-fastapi-instrumentator. Both are written in Python.

Read it as markdown

What they share and what sets them apart

NVIDIA

TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Python15kRead on November 8, 2026, at commit b433473What is TensorRT-LLM built with?

Only in TensorRT-LLM

  • blobfile
  • h5py
  • anyio
  • uvicorn
  • Rich
  • matplotlib
  • Plotly
  • accelerate
  • apache-tvm-ffi
  • cuda-python
  • flash-linear-attention
  • flashinfer-python
  • nvidia-cudnn-frontend
  • openai-codex
  • openai-harmony
  • optimum
  • rouge
  • rouge-score
  • torch-c-dlpack-ext
  • torchao
  • diffusers
  • flash-attn
  • xgrammar
  • librosa
  • mistral-common
  • partial-json-parser
  • tritonclient
  • evaluate
  • llguidance
  • lm-eval
  • jsonlines
  • mako
  • opentelemetry-semantic-conventions-ai
  • boto3

In common

vllm-project

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Python96.3kRead on November 4, 2026, at commit 75f6761What is vllm built with?

Only in vllm

Side by side

SizeLines written by people and agents, without generated ones; code files, without tests.
TensorRT-LLM2,884,778 lines written3,120 code files
vllm2,375,117 lines written3,289 code files
Who writes itA commit counts as AI's when it carries its signature: a Co-Authored-By line, its author name or the merge of its branch.
TensorRT-LLM1.7% of its commits signed by AIWith Claude Code, CodeRabbit, GitHub Copilot, and Cursor
vllm12.8% of its commits signed by AIWith Claude Code, Codex, Gemini CLI, Cursor, GitHub Copilot, Devin, Mistral Vibe, CodeRabbit, Factory, and Qwen Code
ActivityFrom GitHub and its history, on the day SeeRepo read it.
TensorRT-LLMLast push November 8, 202610,997 commits15,038 stars
vllmLast push November 4, 202624,593 commits96,302 stars
TestsThe files that test the code, and the share of code files a test imports.
TensorRT-LLM2,703 test files58.6% of its code files have a test that imports them
vllm2,419 test files60.2% of its code files have a test that imports them

Frequently asked questions

Which is bigger, TensorRT-LLM or vllm?
TensorRT-LLM, with 2,884,778 lines written; vllm has 2,375,117.

The proof: NVIDIA/TensorRT-LLM's code at commit b433473

Which has more GitHub stars, TensorRT-LLM or vllm?
vllm, with 96,302 stars; TensorRT-LLM has 15,038.

The proof: vllm-project/vllm on GitHub

Which has more tests, TensorRT-LLM or vllm?
TensorRT-LLM, with 2,703 test files; vllm has 2,419.

The proof: NVIDIA/TensorRT-LLM's code at commit b433473

Which was updated more recently, TensorRT-LLM or vllm?
TensorRT-LLM: its last push was on November 8, 2026, and vllm's on November 4, 2026.

The proof: NVIDIA/TensorRT-LLM's commits on GitHub

Which has more commits signed by AI, TensorRT-LLM or vllm?
vllm: an AI signed 12.8% of its commits, with Claude Code, Codex, Gemini CLI, Cursor, GitHub Copilot, Devin, Mistral Vibe, CodeRabbit, Factory, and Qwen Code; in TensorRT-LLM, 1.7%.

The proof: the commits each tool signed in vllm-project/vllm

See inside your code, today.

Paste your repo and see it drawn, part by part: a medium one in under a minute.

Free, no account.

Or look inside SeeRepo's own →