Open source repos that use vLLM

10 public repos that SeeRepo read use vLLM. It's used most with tornado, sqlglot, and bitsandbytes.

Read it as markdown

Used most with

  • tornado1 repo
  • bitsandbytes1 repo
  • ModelScope1 repo
  • sentencepiece1 repo
vLLM10 repos
  • sqlglot1 repo
  • ir-datasets1 repo
  • rank-bm251 repo
  • transformers1 repo

The repos, by stars

  1. 1
    hiyouga/LlamaFactory

    Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

    Python+4576kAI 1.6%
  2. 2
    bojieli/ai-agent-book

    《深入理解 AI Agent:设计原理与工程实践》(李博杰 著)开源主仓库:全书正文、编译版 PDF 与按章配套代码

    Python+11757.9kAI 20.8%
  3. 3
    run-llama/llama_index

    LlamaIndex is the document processing platform for AI

    Python+27552.9kAI 0.2%
  4. 4
    mudler/LocalAI

    LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

    Go+14550.3kAI 6%
  5. 5
    hpcaitech/ColossalAI

    Making large AI models cheaper, faster and more accessible

    Python+4641.4kAI 0.3%
  6. 6
    microsoft/unilm

    Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

    Python+2822.2k
  7. 7
    microsoft/RD-Agent

    Research and development (R&D) is crucial for the enhancement of industrial productivity, especially in the AI era, where the core aspects of R&D are mainly focused on data and models. We are committed to automating these high-value generic R&D processes through R&D-Agent, which lets AI drive data-driven AI. 🔗https://aka.ms/RD-Agent-Tech-Report

    Python+5015.3kAI 0.7%
  8. 8
    FlagOpen/FlagEmbedding

    Retrieval and Retrieval-augmented LLMs

    Python+2012.3k
  9. 9
    StarTrail-org/PixelRAG

    https://arxiv.org/abs/2606.28344. The end of web parsing. The beginning of scalable pixel-native search. link: https://pixelrag.ai/

    Python+3310.9kAI 24.1%
  10. 10
    X-PLUG/MobileAgent

    Mobile-Agent: The Powerful GUI Agent Family

    HTML+729.4k

Frequently asked questions

What is the most popular open source repo that uses vLLM?
hiyouga/LlamaFactory, with 76,016 stars on GitHub.

The proof: hiyouga/LlamaFactory on GitHub

What other technologies is vLLM used with?
With tornado (1), sqlglot (1), bitsandbytes (1), ir-datasets (1), and ModelScope (1), out of the 10 repos that use it.
What languages are the repos that use vLLM written in?
Python (8), Go (1), and HTML (1).
How many repos that use vLLM have commits signed by AI?
7 of the 10; the most, StarTrail-org/PixelRAG, with 24.1% of its commits.

The proof: the commits each tool signed in StarTrail-org/PixelRAG

See inside your code, today.

Paste your repo and see it drawn, part by part: a medium one in under a minute.

Free, no account.

Or look inside SeeRepo's own →