Open source repos that use cuda-python
10 public repos that SeeRepo read use cuda-python. It's used most with FastAPI, pyzmq, and uvicorn.
Used most with
FastAPI5 repos
uvicorn4 repos
apache-tvm-ffi4 repos
matplotlib4 repos
- pyzmq5 repos
- AIOHTTP4 repos
- NVIDIA4 repos
OpenAI3 repos
The repos, by stars
- 1vllm-project/
vllm A high-throughput and memory-efficient inference and serving engine for LLMs
Python+10297.1kAI 14.7%
- 2sgl-project/
sglang SGLang is a high-performance serving framework for large language models and multimodal models.
Python+6439kAI 9.5%
- 3blakeblackshear/
frigate NVR with realtime local object detection for IP cameras
TypeScript
+8337.6kAI 0.3% - 5index-tts/
index-tts An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System
Python+2125.2kAI 5.5%
- 6NVIDIA/
TensorRT-LLM TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Python+5815kAI 1.7%
- 8tile-ai/
tilelang Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels
Python+109kAI 4.5%
- 9bojieli/
ai-infra-book 《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
Python+1778kAI 16.6%
Frequently asked questions
What is the most popular open source repo that uses cuda-python?
The proof: vllm-project/vllm on GitHub
What other technologies is cuda-python used with?
What languages are the repos that use cuda-python written in?
How many repos that use cuda-python have commits signed by AI?
The proof: the commits each tool signed in bojieli/ai-infra-book
See inside your code, today.
Paste your repo and see it drawn, part by part: a medium one in under a minute.
Free, no account.Private repo? Sign in with GitHub

