flash-attention vs TensorRT-LLM

flash-attention and TensorRT-LLM share 7 technologies: apache-tvm-ffi, NVIDIA, quack-kernels, torch-c-dlpack-ext, torch, einops, and triton. Both are written in Python.

Read it as markdown

What they share and what sets them apart

Only in flash-attention

  • triton-windows

In common

NVIDIA

TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Python15kRead on November 8, 2026, at commit b433473What is TensorRT-LLM built with?

Only in TensorRT-LLM

Side by side

SizeLines written by people and agents, without generated ones; code files, without tests.
flash-attention139,521 lines written150 code files
TensorRT-LLM2,884,778 lines written3,120 code files
Who writes itA commit counts as AI's when it carries its signature: a Co-Authored-By line, its author name or the merge of its branch.
flash-attention1.7% of its commits signed by AIWith Claude Code, Cursor, and GitHub Copilot
TensorRT-LLM1.7% of its commits signed by AIWith Claude Code, CodeRabbit, GitHub Copilot, and Cursor
ActivityFrom GitHub and its history, on the day SeeRepo read it.
flash-attentionLast push November 16, 20261,613 commits25,304 stars
TensorRT-LLMLast push November 8, 202610,997 commits15,038 stars
TestsThe files that test the code, and the share of code files a test imports.
flash-attention80 test files32% of its code files have a test that imports them
TensorRT-LLM2,703 test files58.6% of its code files have a test that imports them

Frequently asked questions

Which is bigger, flash-attention or TensorRT-LLM?
TensorRT-LLM, with 2,884,778 lines written; flash-attention has 139,521.

The proof: NVIDIA/TensorRT-LLM's code at commit b433473

Which has more GitHub stars, flash-attention or TensorRT-LLM?
flash-attention, with 25,304 stars; TensorRT-LLM has 15,038.

The proof: Dao-AILab/flash-attention on GitHub

Which has more tests, flash-attention or TensorRT-LLM?
TensorRT-LLM, with 2,703 test files; flash-attention has 80.

The proof: NVIDIA/TensorRT-LLM's code at commit b433473

Which was updated more recently, flash-attention or TensorRT-LLM?
flash-attention: its last push was on November 16, 2026, and TensorRT-LLM's on November 8, 2026.

The proof: Dao-AILab/flash-attention's commits on GitHub

Which has more commits signed by AI, flash-attention or TensorRT-LLM?
In both, an AI signed 1.7% of their commits.

The proof: the commits each tool signed in Dao-AILab/flash-attention

See inside your code, today.

Paste your repo and see it drawn, part by part: a medium one in under a minute.

Free, no account.Private repo? Sign in with GitHub

Or look inside SeeRepo's own →