Source: https://seerepo.com/compare/NVIDIA/TensorRT-LLM/vs/run-llama/llama_index
Markdown source: https://seerepo.com/compare/NVIDIA/TensorRT-LLM/vs/run-llama/llama_index.md
Description: TensorRT-LLM and llama_index share 25 technologies: pyzmq, OpenAI, anyio, starlette, Rich, matplotlib, optimum, sentencepiece, tiktoken, torch, transformers, einops, datasets, MCP, tritonclient, peft, pillow, jinja2, Pydantic, jsonschema, opentelemetry-api, psutil, prometheus-client, boto3, and OpenTelemetry. Both are written in Python.

# TensorRT-LLM vs llama_index

TensorRT-LLM and llama_index share 25 technologies: pyzmq, OpenAI, anyio, starlette, Rich, matplotlib, optimum, sentencepiece, tiktoken, torch, transformers, einops, datasets, MCP, tritonclient, peft, pillow, jinja2, Pydantic, jsonschema, opentelemetry-api, psutil, prometheus-client, boto3, and OpenTelemetry. Both are written in Python.

- [NVIDIA/TensorRT-LLM](https://seerepo.com/r/NVIDIA/TensorRT-LLM): TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
- [run-llama/llama_index](https://seerepo.com/r/run-llama/llama_index): LlamaIndex is the document processing platform for AI

## What they share and what sets them apart

- In common: pyzmq, OpenAI, anyio, starlette, Rich, matplotlib, optimum, sentencepiece, tiktoken, torch, transformers, einops, datasets, MCP, tritonclient, peft, pillow, jinja2, Pydantic, jsonschema, opentelemetry-api, psutil, prometheus-client, boto3, OpenTelemetry
- Only in TensorRT-LLM: FastAPI, blobfile, h5py, uvicorn, Plotly, accelerate, apache-tvm-ffi, cuda-python, flash-linear-attention, flashinfer-python, NVIDIA, nvidia-cudnn-frontend, openai-codex, openai-harmony, quack-kernels, rouge, rouge-score, torch-c-dlpack-ext, torchao, triton, diffusers, safetensors, torchvision, flash-attn, xgrammar, librosa, mistral-common, partial-json-parser, evaluate, llguidance, lm-eval, jsonlines, mako, msgspec, opentelemetry-semantic-conventions-ai, opentelemetry-sdk, prometheus-fastapi-instrumentator
- Only in llama_index: aiomysql, aiosqlite, async-lru, asyncpg, azure-search-documents, azure-storage-blob, ibm-db, pgvecto-rs, pgvector, psycopg, psycopg2-binary, Redis, weaviate-client, pyarrow, lancedb, oracledb, DuckDB, pymilvus, SQLite, tablestore, chromadb, falkordb, MySQL, pinecone, clickhouse-connect, gcsfs, pyiceberg, pymochow, pymysql, pyobvector, s3fs, tcvectordb, typesense, ElevenLabs, graphql-core, tornado, AIOHTTP, Ray, soupsieve, tinycss2, ipywidgets, matplotlib-inline, prompt-toolkit, SQLAlchemy, argon2-cffi, azure-identity, Google, google-auth-httplib2, google-auth-oauthlib, cryptography, pyjwt, msal, firecrawl-py, guardrails-ai, llama-index-core, mem0ai, opencv-python, PaddlePaddle, tavily-python, ibm-watsonx-ai, cohere, LangChain, sentence-transformers, dashscope, fastembed, flagembedding, nltk, litellm, ModelScope, Ollama, openvino, scikit-learn, vLLM, exa-py, flashrank, hnswlib, langfuse, mlx, mlx-lm, nomic, paddleocr, presidio-analyzer, tokenizers, beautifulsoup4, bleach, markupsafe, mistune, nbformat, newspaper3k, xlrd, bs4, html2text, unstructured, defusedxml, lxml, pymupdf, filetype, docx2txt, markdownify, docling, lxml-html-clean, markitdown, nbconvert, pdf2image, pdfplumber, pypdf, pypdf2, tinytag, youtube-transcript-api, jsonschema-specifications, marshmallow, referencing, rfc3339-validator, docling-core, annotated-types, pydantic-core, opentelemetry-semantic-conventions, python-json-logger, docker, Alibaba Cloud

## Side by side

| | TensorRT-LLM | llama_index |
|---|---|---|
| Size | 2,884,778 lines written, 3,120 code files | 473,236 lines written, 2,055 code files |
| Who writes it | 1.7% of its commits signed by AI. With Claude Code, CodeRabbit, GitHub Copilot, and Cursor | 0.2% of its commits signed by AI. With Claude Code, Cursor, and GitHub Copilot |
| Activity | Last push November 8, 2026, 10,997 commits, 15,038 stars | Last push November 5, 2026, 7,963 commits, 52,820 stars |
| Tests | 2,703 test files. 58.6% of its code files have a test that imports them | 1,607 test files. 46.5% of its code files have a test that imports them |

- Size: Lines written by people and agents, without generated ones; code files, without tests.
- Who writes it: A commit counts as AI's when it carries its signature: a Co-Authored-By line, its author name or the merge of its branch.
- Activity: From GitHub and its history, on the day SeeRepo read it.
- Tests: The files that test the code, and the share of code files a test imports.

## Frequently asked questions

### Which is bigger, TensorRT-LLM or llama_index?

TensorRT-LLM, with 2,884,778 lines written; llama_index has 473,236.

The proof: [NVIDIA/TensorRT-LLM's code at commit b433473](https://github.com/NVIDIA/TensorRT-LLM/tree/b433473ba0d0d49764f4d2fb3d45c82716b946dc)

### Which has more GitHub stars, TensorRT-LLM or llama_index?

llama_index, with 52,820 stars; TensorRT-LLM has 15,038.

The proof: [run-llama/llama_index on GitHub](https://github.com/run-llama/llama_index)

### Which has more tests, TensorRT-LLM or llama_index?

TensorRT-LLM, with 2,703 test files; llama_index has 1,607.

The proof: [NVIDIA/TensorRT-LLM's code at commit b433473](https://github.com/NVIDIA/TensorRT-LLM/tree/b433473ba0d0d49764f4d2fb3d45c82716b946dc)

### Which was updated more recently, TensorRT-LLM or llama_index?

TensorRT-LLM: its last push was on November 8, 2026, and llama_index's on November 5, 2026.

The proof: [NVIDIA/TensorRT-LLM's commits on GitHub](https://github.com/NVIDIA/TensorRT-LLM/commits)

### Which has more commits signed by AI, TensorRT-LLM or llama_index?

TensorRT-LLM: an AI signed 1.7% of its commits, with Claude Code, CodeRabbit, GitHub Copilot, and Cursor; in llama_index, 0.2%.

The proof: [the commits each tool signed in NVIDIA/TensorRT-LLM](https://seerepo.com/r/NVIDIA/TensorRT-LLM/ai)

## Sources

- NVIDIA/TensorRT-LLM: Read on November 8, 2026, at commit b433473 (https://github.com/NVIDIA/TensorRT-LLM/tree/b433473ba0d0d49764f4d2fb3d45c82716b946dc)
- run-llama/llama_index: Read on November 5, 2026, at commit 444fdf0 (https://github.com/run-llama/llama_index/tree/444fdf0684707de62ebb447d658dba137dd9cb99)

## What is your repo built with?

Any public repo, with no account: https://seerepo.com/r/owner/repo/built, with the owner and name it has on GitHub.