Open source repos that use apache-tvm-ffi
11 public repos that SeeRepo read use apache-tvm-ffi. It's used most with FastAPI, OpenAI, and uvicorn.
Used most with
FastAPI7 repos
uvicorn5 repos
- pyzmq5 repos
flashinfer-python4 repos
OpenAI6 repos- torch5 repos
NVIDIA5 repos
- transformers4 repos
The repos, by stars
- 1vllm-project/
vllm A high-throughput and memory-efficient inference and serving engine for LLMs
Python+10297.1kAI 14.7%
- 2sgl-project/
sglang SGLang is a high-performance serving framework for large language models and multimodal models.
Python+6439kAI 9.5%
- 6FlashML-org/
FreeToken FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
Python
+1016.8k - 7NVIDIA/
TensorRT-LLM TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Python+5815kAI 1.7%
- 8OpenPipe/
ART Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!
Python
+1810.9kAI 6.6% - 9tile-ai/
tilelang Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels
Python+109kAI 4.5%
- 10InternLM/
lmdeploy LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
Python
+318.1kAI 1.2% - 11bojieli/
ai-infra-book 《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
Python+1778kAI 16.6%
Frequently asked questions
What is the most popular open source repo that uses apache-tvm-ffi?
The proof: vllm-project/vllm on GitHub
What other technologies is apache-tvm-ffi used with?
What languages are the repos that use apache-tvm-ffi written in?
How many repos that use apache-tvm-ffi have commits signed by AI?
The proof: the commits each tool signed in bojieli/ai-infra-book
See inside your code, today.
Paste your repo and see it drawn, part by part: a medium one in under a minute.
Free, no account.Private repo? Sign in with GitHub

