SeeRepo
Draw my repo

LocalAI vs TensorRT-LLM

LocalAI and TensorRT-LLM share 24 technologies: MCP, OpenAI, anyio, FastAPI, uvicorn, matplotlib, accelerate, einops, flash-attn, sentencepiece, tiktoken, torchao, torchvision, torch, transformers, diffusers, librosa, datasets, optimum, peft, safetensors, pillow, jinja2, and OpenTelemetry. LocalAI is written in Go and TensorRT-LLM in Python.

Read it as markdown

What they share and what sets them apart

mudler

LocalAI

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Go50.2kRead on November 5, 2026, at commit efc6f93What is LocalAI built with?

Only in LocalAI

In common

NVIDIA

TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Python15kRead on November 8, 2026, at commit b433473What is TensorRT-LLM built with?

Only in TensorRT-LLM

Side by side

SizeLines written by people and agents, without generated ones; code files, without tests.
LocalAI1,389,292 lines written2,979 code files
TensorRT-LLM2,884,778 lines written3,120 code files
Who writes itA commit counts as AI's when it carries its signature: a Co-Authored-By line, its author name or the merge of its branch.
LocalAI3.7% of its commits signed by AIWith Claude Code, GitHub Copilot, and Cursor
TensorRT-LLM1.7% of its commits signed by AIWith Claude Code, CodeRabbit, GitHub Copilot, and Cursor
ActivityFrom GitHub and its history, on the day SeeRepo read it.
LocalAILast push November 5, 20269,317 commits50,214 stars
TensorRT-LLMLast push November 8, 202610,997 commits15,038 stars
TestsThe files that test the code, and the share of code files a test imports.
LocalAI2,911 test files60.8% of its code files have a test that imports them
TensorRT-LLM2,703 test files58.6% of its code files have a test that imports them

Frequently asked questions

Which is bigger, LocalAI or TensorRT-LLM?
TensorRT-LLM, with 2,884,778 lines written; LocalAI has 1,389,292.

The proof: NVIDIA/TensorRT-LLM's code at commit b433473

Which has more GitHub stars, LocalAI or TensorRT-LLM?
LocalAI, with 50,214 stars; TensorRT-LLM has 15,038.

The proof: mudler/LocalAI on GitHub

Which has more tests, LocalAI or TensorRT-LLM?
LocalAI, with 2,911 test files; TensorRT-LLM has 2,703.

The proof: mudler/LocalAI's code at commit efc6f93

Which was updated more recently, LocalAI or TensorRT-LLM?
TensorRT-LLM: its last push was on November 8, 2026, and LocalAI's on November 5, 2026.

The proof: NVIDIA/TensorRT-LLM's commits on GitHub

Which has more commits signed by AI, LocalAI or TensorRT-LLM?
LocalAI: an AI signed 3.7% of its commits, with Claude Code, GitHub Copilot, and Cursor; in TensorRT-LLM, 1.7%.

The proof: the commits each tool signed in mudler/LocalAI

See inside your code, today.

Paste your repo and see it drawn, part by part: a medium one in under a minute.

Free, no account.

Or look inside SeeRepo's own →