lm-evaluation-harness vs TensorRT-LLM
lm-evaluation-harness and TensorRT-LLM share 4 technologies: evaluate, rouge-score, datasets, and jinja2. lm-evaluation-harness is written in C++ and TensorRT-LLM in Python.
What they share and what sets them apart
lm-evaluation-harness
A framework for few-shot evaluation of language models.
C++14.4kRead on November 9, 2026, at commit d6de816What is lm-evaluation-harness built with?Only in lm-evaluation-harness
fugashi
- scikit-learn
- sacrebleu
In common
TensorRT-LLM
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Python15kRead on November 8, 2026, at commit b433473What is TensorRT-LLM built with?Only in TensorRT-LLM
- FastAPI
- blobfile
h5py
- pyzmq
OpenAI- anyio
uvicorn
starlette
- Rich
matplotlib
- Plotly
accelerate
apache-tvm-ffi
- cuda-python
flash-linear-attention
flashinfer-python
- NVIDIA
nvidia-cudnn-frontend
openai-codex
- openai-harmony
optimum
- quack-kernels
- rouge
- sentencepiece
- tiktoken
- torch-c-dlpack-ext
torchao
- torch
- triton
- transformers
diffusers
- einops
safetensors
torchvision
- flash-attn
xgrammar
librosa
- MCP
- mistral-common
partial-json-parser
- tritonclient
- llguidance
lm-eval
peft
- jsonlines
pillow
- mako
- Pydantic
msgspec
- jsonschema
opentelemetry-api
- opentelemetry-semantic-conventions-ai
psutil
prometheus-client
- boto3
- OpenTelemetry
opentelemetry-sdk
- prometheus-fastapi-instrumentator
Side by side
Frequently asked questions
Which is bigger, lm-evaluation-harness or TensorRT-LLM?
The proof: NVIDIA/TensorRT-LLM's code at commit b433473
Which has more GitHub stars, lm-evaluation-harness or TensorRT-LLM?
The proof: NVIDIA/TensorRT-LLM on GitHub
Which has more tests, lm-evaluation-harness or TensorRT-LLM?
The proof: NVIDIA/TensorRT-LLM's code at commit b433473
Which was updated more recently, lm-evaluation-harness or TensorRT-LLM?
The proof: NVIDIA/TensorRT-LLM's commits on GitHub
Which has more commits signed by AI, lm-evaluation-harness or TensorRT-LLM?
The proof: the commits each tool signed in NVIDIA/TensorRT-LLM
See inside your code, today.
Paste your repo and see it drawn, part by part: a medium one in under a minute.
Free, no account.Private repo? Sign in with GitHub

