Open source repos that use apache-tvm-ffi

11 public repos that SeeRepo read use apache-tvm-ffi. It's used most with FastAPI, OpenAI, and uvicorn.

Read it as markdown

Used most with

  • FastAPI7 repos
  • uvicorn5 repos
  • pyzmq5 repos
  • flashinfer-python4 repos
apache-tvm-ffi11 repos
  • OpenAI6 repos
  • torch5 repos
  • NVIDIA5 repos
  • transformers4 repos

The repos, by stars

  1. 1
    vllm-project/vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python+10297.1kAI 14.7%
  2. 2
    sgl-project/sglang

    SGLang is a high-performance serving framework for large language models and multimodal models.

    Python+6439kAI 9.5%
  3. 3
    Dao-AILab/flash-attention

    Fast and memory-efficient exact attention

    Python+425.3kAI 1.7%
  4. 4
    mlc-ai/mlc-llm

    Universal LLM Deployment Engine with ML Compilation

    Python+1723.3kAI 0.2%
  5. 5
    state-spaces/mamba

    Mamba SSM architecture

    Python+219kAI 0.5%
  6. 6
    FlashML-org/FreeToken

    FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

    Python+1016.8k
  7. 7
    NVIDIA/TensorRT-LLM

    TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

    Python+5815kAI 1.7%
  8. 8
    OpenPipe/ART

    Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!

    Python+1810.9kAI 6.6%
  9. 9
    tile-ai/tilelang

    Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels

    Python+109kAI 4.5%
  10. 10
    InternLM/lmdeploy

    LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

    Python+318.1kAI 1.2%
  11. 11
    bojieli/ai-infra-book

    《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验

    Python+1778kAI 16.6%

Frequently asked questions

What is the most popular open source repo that uses apache-tvm-ffi?
vllm-project/vllm, with 97,060 stars on GitHub.

The proof: vllm-project/vllm on GitHub

What other technologies is apache-tvm-ffi used with?
With FastAPI (7), OpenAI (6), uvicorn (5), torch (5), and pyzmq (5), out of the 11 repos that use it.
What languages are the repos that use apache-tvm-ffi written in?
Python (11).
How many repos that use apache-tvm-ffi have commits signed by AI?
10 of the 11; the most, bojieli/ai-infra-book, with 16.6% of its commits.

The proof: the commits each tool signed in bojieli/ai-infra-book

See inside your code, today.

Paste your repo and see it drawn, part by part: a medium one in under a minute.

Free, no account.Private repo? Sign in with GitHub

Or look inside SeeRepo's own →