Source: https://seerepo.com/uses/vllm
Markdown source: https://seerepo.com/uses/vllm.md
Description: 10 public repos that SeeRepo read use vLLM. It's used most with tornado, sqlglot, and bitsandbytes.

# Open source repos that use vLLM

10 public repos that SeeRepo read use vLLM. It's used most with tornado, sqlglot, and bitsandbytes.

## Used most with

- tornado: 1 repo
- sqlglot: 1 repo
- bitsandbytes: 1 repo
- ir-datasets: 1 repo
- ModelScope: 1 repo
- rank-bm25: 1 repo
- sentencepiece: 1 repo
- transformers: 1 repo

## The repos, by stars

1. [hiyouga/LlamaFactory](https://seerepo.com/r/hiyouga/LlamaFactory): Python · 76,016 stars · 1.6% signed by AI — Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
2. [bojieli/ai-agent-book](https://seerepo.com/r/bojieli/ai-agent-book): Python · 57,873 stars · 20.8% signed by AI — 《深入理解 AI Agent：设计原理与工程实践》（李博杰 著）开源主仓库：全书正文、编译版 PDF 与按章配套代码
3. [run-llama/llama_index](https://seerepo.com/r/run-llama/llama_index): Python · 52,885 stars · 0.2% signed by AI — LlamaIndex is the document processing platform for AI
4. [mudler/LocalAI](https://seerepo.com/r/mudler/LocalAI): Go · 50,345 stars · 6% signed by AI — LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
5. [hpcaitech/ColossalAI](https://seerepo.com/r/hpcaitech/ColossalAI): Python · 41,424 stars · 0.3% signed by AI — Making large AI models cheaper, faster and more accessible
6. [microsoft/unilm](https://seerepo.com/r/microsoft/unilm): Python · 22,240 stars — Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
7. [microsoft/RD-Agent](https://seerepo.com/r/microsoft/RD-Agent): Python · 15,282 stars · 0.7% signed by AI — Research and development (R&D) is crucial for the enhancement of industrial productivity, especially in the AI era, where the core aspects of R&D are mainly focused on data and models. We are committed to automating these high-value generic R&D processes through R&D-Agent, which lets AI drive data-driven AI. 🔗https://aka.ms/RD-Agent-Tech-Report
8. [FlagOpen/FlagEmbedding](https://seerepo.com/r/FlagOpen/FlagEmbedding): Python · 12,314 stars — Retrieval and Retrieval-augmented LLMs
9. [StarTrail-org/PixelRAG](https://seerepo.com/r/StarTrail-org/PixelRAG): Python · 10,914 stars · 24.1% signed by AI — https://arxiv.org/abs/2606.28344. The end of web parsing. The beginning of scalable pixel-native search. link: https://pixelrag.ai/
10. [X-PLUG/MobileAgent](https://seerepo.com/r/X-PLUG/MobileAgent): HTML · 9,379 stars —  Mobile-Agent: The Powerful GUI Agent Family

## Frequently asked questions

### What is the most popular open source repo that uses vLLM?

hiyouga/LlamaFactory, with 76,016 stars on GitHub.

The proof: [hiyouga/LlamaFactory on GitHub](https://github.com/hiyouga/LlamaFactory)

### What other technologies is vLLM used with?

With tornado (1), sqlglot (1), bitsandbytes (1), ir-datasets (1), and ModelScope (1), out of the 10 repos that use it.

### What languages are the repos that use vLLM written in?

Python (8), Go (1), and HTML (1).

### How many repos that use vLLM have commits signed by AI?

7 of the 10; the most, StarTrail-org/PixelRAG, with 24.1% of its commits.

The proof: [the commits each tool signed in StarTrail-org/PixelRAG](https://seerepo.com/r/StarTrail-org/PixelRAG/ai)

## What is your repo built with?

Any public repo, with no account: https://seerepo.com/r/owner/repo/built, with the owner and name it has on GitHub.
