Open source repos that use cuda-python

10 public repos that SeeRepo read use cuda-python. It's used most with FastAPI, pyzmq, and uvicorn.

Read it as markdown

Used most with

  • FastAPI5 repos
  • uvicorn4 repos
  • apache-tvm-ffi4 repos
  • matplotlib4 repos
cuda-python10 repos
  • pyzmq5 repos
  • AIOHTTP4 repos
  • NVIDIA4 repos
  • OpenAI3 repos

The repos, by stars

  1. 1
    vllm-project/vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python+10297.1kAI 14.7%
  2. 2
    sgl-project/sglang

    SGLang is a high-performance serving framework for large language models and multimodal models.

    Python+6439kAI 9.5%
  3. 3
    blakeblackshear/frigate

    NVR with realtime local object detection for IP cameras

    TypeScript+8337.6kAI 0.3%
  4. 4
    liguodongiot/llm-action

    本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)

    HTML+9925.3k
  5. 5
    index-tts/index-tts

    An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System

    Python+2125.2kAI 5.5%
  6. 6
    NVIDIA/TensorRT-LLM

    TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

    Python+5815kAI 1.7%
  7. 7
    LMCache/LMCache

    LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

    Python+3212.3kAI 4%
  8. 8
    tile-ai/tilelang

    Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels

    Python+109kAI 4.5%
  9. 9
    bojieli/ai-infra-book

    《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验

    Python+1778kAI 16.6%
  10. 10
    Python+357.7k

Frequently asked questions

What is the most popular open source repo that uses cuda-python?
vllm-project/vllm, with 97,060 stars on GitHub.

The proof: vllm-project/vllm on GitHub

What other technologies is cuda-python used with?
With FastAPI (5), pyzmq (5), uvicorn (4), AIOHTTP (4), and apache-tvm-ffi (4), out of the 10 repos that use it.
What languages are the repos that use cuda-python written in?
Python (8), HTML (1), and TypeScript (1).
How many repos that use cuda-python have commits signed by AI?
8 of the 10; the most, bojieli/ai-infra-book, with 16.6% of its commits.

The proof: the commits each tool signed in bojieli/ai-infra-book

See inside your code, today.

Paste your repo and see it drawn, part by part: a medium one in under a minute.

Free, no account.Private repo? Sign in with GitHub

Or look inside SeeRepo's own →