Source: https://seerepo.com/uses/cuda-python
Markdown source: https://seerepo.com/uses/cuda-python.md
Description: 10 public repos that SeeRepo read use cuda-python. It's used most with FastAPI, pyzmq, and uvicorn.

# Open source repos that use cuda-python

10 public repos that SeeRepo read use cuda-python. It's used most with FastAPI, pyzmq, and uvicorn.

## Used most with

- FastAPI: 5 repos
- pyzmq: 5 repos
- uvicorn: 4 repos
- AIOHTTP: 4 repos
- apache-tvm-ffi: 4 repos
- NVIDIA: 4 repos
- matplotlib: 4 repos
- OpenAI: 3 repos

## The repos, by stars

1. [vllm-project/vllm](https://seerepo.com/r/vllm-project/vllm): Python · 97,060 stars · 14.7% signed by AI — A high-throughput and memory-efficient inference and serving engine for LLMs
2. [sgl-project/sglang](https://seerepo.com/r/sgl-project/sglang): Python · 39,041 stars · 9.5% signed by AI — SGLang is a high-performance serving framework for large language models and multimodal models.
3. [blakeblackshear/frigate](https://seerepo.com/r/blakeblackshear/frigate): TypeScript · 37,644 stars · 0.3% signed by AI — NVR with realtime local object detection for IP cameras
4. [liguodongiot/llm-action](https://seerepo.com/r/liguodongiot/llm-action): HTML · 25,296 stars — 本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
5. [index-tts/index-tts](https://seerepo.com/r/index-tts/index-tts): Python · 25,216 stars · 5.5% signed by AI — An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System
6. [NVIDIA/TensorRT-LLM](https://seerepo.com/r/NVIDIA/TensorRT-LLM): Python · 15,038 stars · 1.7% signed by AI — TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
7. [LMCache/LMCache](https://seerepo.com/r/LMCache/LMCache): Python · 12,336 stars · 4% signed by AI — LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
8. [tile-ai/tilelang](https://seerepo.com/r/tile-ai/tilelang): Python · 8,976 stars · 4.5% signed by AI —  Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels
9. [bojieli/ai-infra-book](https://seerepo.com/r/bojieli/ai-infra-book): Python · 8,032 stars · 16.6% signed by AI — 《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
10. [facebookresearch/sam-3d-objects](https://seerepo.com/r/facebookresearch/sam-3d-objects): Python · 7,696 stars — SAM 3D Objects

## Frequently asked questions

### What is the most popular open source repo that uses cuda-python?

vllm-project/vllm, with 97,060 stars on GitHub.

The proof: [vllm-project/vllm on GitHub](https://github.com/vllm-project/vllm)

### What other technologies is cuda-python used with?

With FastAPI (5), pyzmq (5), uvicorn (4), AIOHTTP (4), and apache-tvm-ffi (4), out of the 10 repos that use it.

### What languages are the repos that use cuda-python written in?

Python (8), HTML (1), and TypeScript (1).

### How many repos that use cuda-python have commits signed by AI?

8 of the 10; the most, bojieli/ai-infra-book, with 16.6% of its commits.

The proof: [the commits each tool signed in bojieli/ai-infra-book](https://seerepo.com/r/bojieli/ai-infra-book/ai)

## What is your repo built with?

Any public repo, with no account: https://seerepo.com/r/owner/repo/built, with the owner and name it has on GitHub.
