lm-evaluation-harness vs TensorRT-LLM

lm-evaluation-harness and TensorRT-LLM share 4 technologies: evaluate, rouge-score, datasets, and jinja2. lm-evaluation-harness is written in C++ and TensorRT-LLM in Python.

Read it as markdown

What they share and what sets them apart

Only in lm-evaluation-harness

In common

NVIDIA

TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Python15kRead on November 8, 2026, at commit b433473What is TensorRT-LLM built with?

Only in TensorRT-LLM

Side by side

SizeLines written by people and agents, without generated ones; code files, without tests.
lm-evaluation-harness107,687 lines written2 code files
TensorRT-LLM2,884,778 lines written3,120 code files
Who writes itA commit counts as AI's when it carries its signature: a Co-Authored-By line, its author name or the merge of its branch.
lm-evaluation-harness0.3% of its commits signed by AIWith Claude Code and Cursor
TensorRT-LLM1.7% of its commits signed by AIWith Claude Code, CodeRabbit, GitHub Copilot, and Cursor
ActivityFrom GitHub and its history, on the day SeeRepo read it.
lm-evaluation-harnessLast push November 4, 20263,347 commits14,426 stars
TensorRT-LLMLast push November 8, 202610,997 commits15,038 stars
TestsThe files that test the code, and the share of code files a test imports.
lm-evaluation-harness51 test files
TensorRT-LLM2,703 test files58.6% of its code files have a test that imports them

Frequently asked questions

Which is bigger, lm-evaluation-harness or TensorRT-LLM?
TensorRT-LLM, with 2,884,778 lines written; lm-evaluation-harness has 107,687.

The proof: NVIDIA/TensorRT-LLM's code at commit b433473

Which has more GitHub stars, lm-evaluation-harness or TensorRT-LLM?
TensorRT-LLM, with 15,038 stars; lm-evaluation-harness has 14,426.

The proof: NVIDIA/TensorRT-LLM on GitHub

Which has more tests, lm-evaluation-harness or TensorRT-LLM?
TensorRT-LLM, with 2,703 test files; lm-evaluation-harness has 51.

The proof: NVIDIA/TensorRT-LLM's code at commit b433473

Which was updated more recently, lm-evaluation-harness or TensorRT-LLM?
TensorRT-LLM: its last push was on November 8, 2026, and lm-evaluation-harness's on November 4, 2026.

The proof: NVIDIA/TensorRT-LLM's commits on GitHub

Which has more commits signed by AI, lm-evaluation-harness or TensorRT-LLM?
TensorRT-LLM: an AI signed 1.7% of its commits, with Claude Code, CodeRabbit, GitHub Copilot, and Cursor; in lm-evaluation-harness, 0.3%.

The proof: the commits each tool signed in NVIDIA/TensorRT-LLM

See inside your code, today.

Paste your repo and see it drawn, part by part: a medium one in under a minute.

Free, no account.Private repo? Sign in with GitHub

Or look inside SeeRepo's own →