TensorRT-LLM vs sglang

TensorRT-LLM and sglang share 29 technologies: FastAPI, blobfile, pyzmq, OpenAI, uvicorn, apache-tvm-ffi, cuda-python, flashinfer-python, NVIDIA, openai-harmony, quack-kernels, sentencepiece, tiktoken, torch-c-dlpack-ext, torch, transformers, einops, torchvision, datasets, xgrammar, mistral-common, partial-json-parser, llguidance, pillow, Pydantic, msgspec, psutil, prometheus-client, and OpenTelemetry. Both are written in Python.

Read it as markdown

What they share and what sets them apart

NVIDIA

TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Python15kRead on November 8, 2026, at commit b433473What is TensorRT-LLM built with?

Only in TensorRT-LLM

In common

sgl-project

sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

Python38.5kRead on November 6, 2026, at commit 0afb736What is sglang built with?

Only in sglang

Side by side

SizeLines written by people and agents, without generated ones; code files, without tests.
TensorRT-LLM2,884,778 lines written3,120 code files
sglang3,312,331 lines written4,627 code files
Who writes itA commit counts as AI's when it carries its signature: a Co-Authored-By line, its author name or the merge of its branch.
TensorRT-LLM1.7% of its commits signed by AIWith Claude Code, CodeRabbit, GitHub Copilot, and Cursor
sglang8.7% of its commits signed by AIWith Claude Code, Gemini CLI, Cursor, GitHub Copilot, Devin, Codex, CodeRabbit, and OpenHands
ActivityFrom GitHub and its history, on the day SeeRepo read it.
TensorRT-LLMLast push November 8, 202610,997 commits15,038 stars
sglangLast push November 6, 202621,830 commits38,542 stars
TestsThe files that test the code, and the share of code files a test imports.
TensorRT-LLM2,703 test files58.6% of its code files have a test that imports them
sglang4,212 test files59.6% of its code files have a test that imports them

Frequently asked questions

Which is bigger, TensorRT-LLM or sglang?
sglang, with 3,312,331 lines written; TensorRT-LLM has 2,884,778.

The proof: sgl-project/sglang's code at commit 0afb736

Which has more GitHub stars, TensorRT-LLM or sglang?
sglang, with 38,542 stars; TensorRT-LLM has 15,038.

The proof: sgl-project/sglang on GitHub

Which has more tests, TensorRT-LLM or sglang?
sglang, with 4,212 test files; TensorRT-LLM has 2,703.

The proof: sgl-project/sglang's code at commit 0afb736

Which was updated more recently, TensorRT-LLM or sglang?
TensorRT-LLM: its last push was on November 8, 2026, and sglang's on November 6, 2026.

The proof: NVIDIA/TensorRT-LLM's commits on GitHub

Which has more commits signed by AI, TensorRT-LLM or sglang?
sglang: an AI signed 8.7% of its commits, with Claude Code, Gemini CLI, Cursor, GitHub Copilot, Devin, Codex, CodeRabbit, and OpenHands; in TensorRT-LLM, 1.7%.

The proof: the commits each tool signed in sgl-project/sglang

See inside your code, today.

Paste your repo and see it drawn, part by part: a medium one in under a minute.

Free, no account.

Or look inside SeeRepo's own →