SeeRepo
Draw my repo

TensorRT-LLM vs ray

TensorRT-LLM and ray share 35 technologies: FastAPI, h5py, pyzmq, anyio, uvicorn, starlette, Rich, matplotlib, Plotly, accelerate, rouge-score, sentencepiece, tiktoken, torch, triton, transformers, diffusers, einops, safetensors, torchvision, datasets, evaluate, lm-eval, peft, jsonlines, pillow, jinja2, mako, Pydantic, jsonschema, opentelemetry-api, psutil, prometheus-client, boto3, and OpenTelemetry. Both are written in Python.

Read it as markdown

What they share and what sets them apart

NVIDIA

TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Python15kRead on November 8, 2026, at commit b433473What is TensorRT-LLM built with?

Only in TensorRT-LLM

  • blobfile
  • OpenAI
  • apache-tvm-ffi
  • cuda-python
  • flash-linear-attention
  • flashinfer-python
  • NVIDIA
  • nvidia-cudnn-frontend
  • openai-codex
  • openai-harmony
  • optimum
  • quack-kernels
  • rouge
  • torch-c-dlpack-ext
  • torchao
  • flash-attn
  • xgrammar
  • librosa
  • MCP
  • mistral-common
  • partial-json-parser
  • tritonclient
  • llguidance
  • msgspec
  • opentelemetry-semantic-conventions-ai
  • opentelemetry-sdk
  • prometheus-fastapi-instrumentator

In common

ray-project

ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Python44.2kRead on November 6, 2026, at commit 77567c5What is ray built with?

Only in ray

Side by side

SizeLines written by people and agents, without generated ones; code files, without tests.
TensorRT-LLM2,884,778 lines written3,120 code files
ray1,531,664 lines written2,777 code files
Who writes itA commit counts as AI's when it carries its signature: a Co-Authored-By line, its author name or the merge of its branch.
TensorRT-LLM1.7% of its commits signed by AIWith Claude Code, CodeRabbit, GitHub Copilot, and Cursor
ray3.6% of its commits signed by AIWith Claude Code, Gemini CLI, GitHub Copilot, Cursor, and Codex
ActivityFrom GitHub and its history, on the day SeeRepo read it.
TensorRT-LLMLast push November 8, 202610,997 commits15,038 stars
rayLast push November 6, 202632,373 commits44,213 stars
TestsThe files that test the code, and the share of code files a test imports.
TensorRT-LLM2,703 test files58.6% of its code files have a test that imports them
ray2,168 test files9.7% of its code files have a test that imports them

Frequently asked questions

Which is bigger, TensorRT-LLM or ray?
TensorRT-LLM, with 2,884,778 lines written; ray has 1,531,664.

The proof: NVIDIA/TensorRT-LLM's code at commit b433473

Which has more GitHub stars, TensorRT-LLM or ray?
ray, with 44,213 stars; TensorRT-LLM has 15,038.

The proof: ray-project/ray on GitHub

Which has more tests, TensorRT-LLM or ray?
TensorRT-LLM, with 2,703 test files; ray has 2,168.

The proof: NVIDIA/TensorRT-LLM's code at commit b433473

Which was updated more recently, TensorRT-LLM or ray?
TensorRT-LLM: its last push was on November 8, 2026, and ray's on November 6, 2026.

The proof: NVIDIA/TensorRT-LLM's commits on GitHub

Which has more commits signed by AI, TensorRT-LLM or ray?
ray: an AI signed 3.6% of its commits, with Claude Code, Gemini CLI, GitHub Copilot, Cursor, and Codex; in TensorRT-LLM, 1.7%.

The proof: the commits each tool signed in ray-project/ray

See inside your code, today.

Paste your repo and see it drawn, part by part: a medium one in under a minute.

Free, no account.

Or look inside SeeRepo's own →