Source: https://seerepo.com/r/vllm-project/vllm-omni/built
Markdown source: https://seerepo.com/r/vllm-project/vllm-omni/built.md
Description: vllm-omni is a Python repo built with FastAPI, werkzeug, and AIOHTTP. It uses AI through accelerate, auto-round-lib, facexlib, fairscale, filterpy, and 33 more.

# What is vllm-omni built with?

vllm-omni is a Python repo built with FastAPI, werkzeug, and AIOHTTP. It uses AI through accelerate, auto-round-lib, facexlib, fairscale, filterpy, and 33 more, makes its content with markdown, markdown-it-py, markupsafe, mdurl, tifffile, and 5 more, validates its data with Pydantic and msgspec, is tested with Pytest, datasets, and peft, runs in production with opentelemetry-exporter-http-transport, opentelemetry-exporter-otlp-common, opentelemetry-exporter-prometheus, opentelemetry-semantic-conventions, opentelemetry-semantic-conventions-ai, and 3 more, and uses lmdb, pyarrow, tensorboard-data-server, pyzmq, and Hugging Face. It has 1,649,609 written lines, with 2,401 test files.

Read on November 18, 2026, at commit 07dd3d0.

Repository: https://github.com/vllm-project/vllm-omni

## Frontend

### Styles

- **[cycler](https://seerepo.com/uses/cycler)**
- **[fonttools](https://seerepo.com/uses/fonttools)**

### Interface

- **[contourpy](https://seerepo.com/uses/contourpy)**
- **[matplotlib](https://seerepo.com/uses/matplotlib)**
- **[Rich](https://seerepo.com/uses/rich)**

## Backend

### The base

- **[FastAPI](https://seerepo.com/uses/fastapi)**

### Data

- **lmdb**
- **[pyarrow](https://seerepo.com/uses/pyarrow)**
- **tensorboard-data-server**
- **[pyzmq](https://seerepo.com/uses/pyzmq)**: 12 files

### AI

- **[accelerate](https://seerepo.com/uses/accelerate)**
- **auto-round-lib**
- **facexlib**
- **fairscale**
- **filterpy**
- **fvcore**
- **[gguf](https://seerepo.com/uses/gguf)**
- **[llvmlite](https://seerepo.com/uses/llvmlite)**
- **lmcache**
- **[NVIDIA](https://seerepo.com/uses/nvidia)**
- **[nvidia-cudnn-cu12](https://seerepo.com/uses/nvidia-cudnn-cu12)**
- **nvidia-cudnn-cu13**
- **onnxruntime-rocm**
- **[open-clip-torch](https://seerepo.com/uses/open-clip-torch)**
- **[openai-whisper](https://seerepo.com/uses/openai-whisper)**
- **[qwen-vl-utils](https://seerepo.com/uses/qwen-vl-utils)**
- **[scikit-image](https://seerepo.com/uses/scikit-image)**
- **[timm](https://seerepo.com/uses/timm)**
- **torchsde**
- **[trl](https://seerepo.com/uses/trl)**
- **[torch](https://seerepo.com/uses/torch)**: 1,192 files
- **[transformers](https://seerepo.com/uses/transformers)**: 274 files
- **[diffusers](https://seerepo.com/uses/diffusers)**: 151 files
- **[safetensors](https://seerepo.com/uses/safetensors)**: 62 files
- **[einops](https://seerepo.com/uses/einops)**: 35 files
- **[torchaudio](https://seerepo.com/uses/torchaudio)**: 33 files
- **cache-dit**: 25 files
- **[torchvision](https://seerepo.com/uses/torchvision)**: 15 files
- **[triton](https://seerepo.com/uses/triton)**: 8 files
- **[onnxruntime](https://seerepo.com/uses/onnxruntime)**: 7 files
- **[opencv-python](https://seerepo.com/uses/opencv-python)**: 6 files
- **x-transformers**: 6 files
- **[tokenizers](https://seerepo.com/uses/tokenizers)**: 5 files
- **s3tokenizer**: 3 files
- **kernels**: 2 files
- **[sentencepiece](https://seerepo.com/uses/sentencepiece)**: 2 files
- **[bitsandbytes](https://seerepo.com/uses/bitsandbytes)**: 1 file
- **torchada**: 1 file

### Services

- **[Hugging Face](https://seerepo.com/uses/hugging-face)**: 14 files · [vllm_omni/diffusion/data.py, line 16](https://github.com/vllm-project/vllm-omni/blob/07dd3d0cdea3325d8026a93485b60dfe3be6f29d/vllm_omni/diffusion/data.py#L16)

## Support

### The base

- **[werkzeug](https://seerepo.com/uses/werkzeug)**
- **[AIOHTTP](https://seerepo.com/uses/aiohttp)**: 2 files

### Content

- **[markdown](https://seerepo.com/uses/markdown)**
- **[markdown-it-py](https://seerepo.com/uses/markdown-it-py)**
- **[markupsafe](https://seerepo.com/uses/markupsafe)**
- **[mdurl](https://seerepo.com/uses/mdurl)**
- **tifffile**
- **[pillow](https://seerepo.com/uses/pillow)**: 96 files
- **[av](https://seerepo.com/uses/av)**: 12 files
- **[imageio](https://seerepo.com/uses/imageio)**: 3 files
- **decord**: 2 files
- **[jinja2](https://seerepo.com/uses/jinja2)**: 1 file

### Validation

- **[Pydantic](https://seerepo.com/uses/pydantic)**: 24 files
- **[msgspec](https://seerepo.com/uses/msgspec)**: 19 files

### Testing

- **Pytest**: 2,184 files
- **[datasets](https://seerepo.com/uses/datasets)**: 1 file
- **[peft](https://seerepo.com/uses/peft)**: 1 file

### Deploy

- **opentelemetry-exporter-http-transport**
- **opentelemetry-exporter-otlp-common**
- **opentelemetry-exporter-prometheus**
- **[opentelemetry-semantic-conventions](https://seerepo.com/uses/opentelemetry-semantic-conventions)**
- **opentelemetry-semantic-conventions-ai**
- **[psutil](https://seerepo.com/uses/psutil)**: 2 files
- **[OpenTelemetry](https://seerepo.com/uses/opentelemetry)**: 1 file
- **[opentelemetry-exporter-otlp-proto-grpc](https://seerepo.com/uses/opentelemetry-exporter-otlp-proto-grpc)**: 1 file

### Tools

- **antlr4-python3-runtime**
- **cfgv**
- **clip**
- **distlib**
- **fire**
- **identify**
- **iniconfig**
- **nodeenv**
- **Numba**
- **pluggy**
- **pre-commit**
- **pygments**
- **python-discovery**
- **Ruff**
- **Setuptools**
- **tensorboard**
- **virtualenv**
- **yapf**
- **typing-extensions**: 17 files
- **packaging**: 6 files

### Other

- **absl-py**
- **addict**
- **aiohappyeyeballs**
- **aiosignal**
- **attrs**
- **certifi**
- **charset-normalizer**
- **dill**
- **easydict**
- **frozenlist**
- **fsspec**
- **ftfy**
- **future**
- **grpcio**
- **hf-xet**
- **idna**
- **iopath**
- **kiwisolver**
- **lazy-loader**
- **mpmath**
- **multidict**
- **multiprocess**
- **networkx**
- **nvidia-nccl-cu12**
- **opencv-python-headless**
- **opentelemetry-exporter-otlp-proto-common**
- **platformdirs**
- **portalocker**
- **propcache**
- **protobuf**
- **pyparsing**
- **python-dateutil**
- **six**
- **soxr**
- **termcolor**
- **urllib3**
- **wcwidth**
- **xxhash**
- **yacs**
- **yarl**
- **NumPy**: 293 files
- **regex**: 50 files
- **omegaconf**: 18 files
- **soundfile**: 14 files
- **SciPy**: 8 files
- **tqdm**: 7 files
- **janus**: 5 files
- **filelock**: 3 files
- **pyyaml**: 3 files
- **inflect**: 2 files
- **aenum**: 1 file
- **msgpack**: 1 file
- **pandas**: 1 file
- **prettytable**: 1 file
- **pydantic-settings**: 1 file
- **requests**: 1 file
- **SymPy**: 1 file
- **tabulate**: 1 file

## Other repos with a similar stack

- [ray-project/ray](https://seerepo.com/r/ray-project/ray/built): FastAPI, pyarrow, tensorboard-data-server, pyzmq, Hugging Face, werkzeug, AIOHTTP, cycler, fonttools, contourpy, Rich, fairscale, llvmlite, openai-whisper, scikit-image, timm, torch, transformers, diffusers, safetensors, einops, torchvision, triton, onnxruntime, tokenizers, sentencepiece, bitsandbytes, markdown, markdown-it-py, markupsafe, mdurl, pillow, imageio, decord, jinja2, Pydantic, opentelemetry-exporter-prometheus, opentelemetry-semantic-conventions, psutil, OpenTelemetry, opentelemetry-exporter-otlp-proto-grpc · [Compare](https://seerepo.com/compare/ray-project/ray/vs/vllm-project/vllm-omni)
- [onyx-dot-app/onyx](https://seerepo.com/r/onyx-dot-app/onyx/built): FastAPI, pyzmq, Hugging Face, werkzeug, AIOHTTP, cycler, fonttools, contourpy, Rich, accelerate, NVIDIA, nvidia-cudnn-cu12, torch, transformers, safetensors, einops, triton, onnxruntime, tokenizers, markdown-it-py, markupsafe, mdurl, pillow, jinja2, Pydantic, opentelemetry-exporter-http-transport, opentelemetry-exporter-otlp-common, opentelemetry-semantic-conventions, psutil, OpenTelemetry · [Compare](https://seerepo.com/compare/onyx-dot-app/onyx/vs/vllm-project/vllm-omni)
- [mudler/LocalAI](https://seerepo.com/r/mudler/LocalAI/built): FastAPI, pyarrow, Hugging Face, matplotlib, accelerate, llvmlite, NVIDIA, scikit-image, trl, torch, transformers, diffusers, safetensors, einops, torchaudio, torchvision, onnxruntime, opencv-python, tokenizers, s3tokenizer, sentencepiece, bitsandbytes, markupsafe, pillow, av, imageio, jinja2, OpenTelemetry · [Compare](https://seerepo.com/compare/mudler/LocalAI/vs/vllm-project/vllm-omni)
- [vllm-project/vllm](https://seerepo.com/r/vllm-project/vllm/built): FastAPI, pyzmq, Hugging Face, AIOHTTP, auto-round-lib, lmcache, NVIDIA, timm, torch, transformers, safetensors, einops, torchaudio, torchvision, triton, tokenizers, sentencepiece, markdown, markupsafe, pillow, jinja2, Pydantic, msgspec, opentelemetry-semantic-conventions-ai, psutil, OpenTelemetry · [Compare](https://seerepo.com/compare/vllm-project/vllm/vs/vllm-project/vllm-omni)
- [OpenBMB/MiniCPM-V](https://seerepo.com/r/OpenBMB/MiniCPM-V/built): FastAPI, AIOHTTP, cycler, fonttools, contourpy, matplotlib, Rich, accelerate, fairscale, timm, torch, transformers, einops, torchaudio, torchvision, onnxruntime, opencv-python, tokenizers, sentencepiece, bitsandbytes, pillow, imageio, decord, Pydantic, psutil · [Compare](https://seerepo.com/compare/OpenBMB/MiniCPM-V/vs/vllm-project/vllm-omni)
- [unslothai/unsloth](https://seerepo.com/r/unslothai/unsloth/built): FastAPI, Hugging Face, matplotlib, Rich, accelerate, gguf, openai-whisper, timm, trl, torch, transformers, diffusers, safetensors, einops, tokenizers, kernels, sentencepiece, markdown-it-py, mdurl, pillow, av, jinja2, Pydantic, psutil · [Compare](https://seerepo.com/compare/unslothai/unsloth/vs/vllm-project/vllm-omni)

## Frequently asked questions

### What language is vllm-omni written in?

vllm-omni is written in Python, with 1,649,609 written lines.

### What framework does vllm-omni use?

vllm-omni is built with FastAPI, werkzeug, and AIOHTTP.

### Does vllm-omni use AI?

Yes. vllm-omni uses AI through accelerate, auto-round-lib, facexlib, fairscale, filterpy, fvcore, gguf, llvmlite, lmcache, NVIDIA, nvidia-cudnn-cu12, nvidia-cudnn-cu13, onnxruntime-rocm, open-clip-torch, openai-whisper, qwen-vl-utils, scikit-image, timm, torchsde, trl, torch, transformers, diffusers, safetensors, einops, torchaudio, cache-dit, torchvision, triton, onnxruntime, opencv-python, x-transformers, tokenizers, s3tokenizer, kernels, sentencepiece, bitsandbytes, and torchada.

### What services does vllm-omni use?

vllm-omni uses lmdb, pyarrow, tensorboard-data-server, pyzmq, and Hugging Face.

### Does vllm-omni have tests?

Yes. vllm-omni has 2,401 test files and is tested with Pytest, datasets, and peft.

### Which repos have a stack like vllm-omni's?

The ones that share most of its stack: ray-project/ray, onyx-dot-app/onyx, and mudler/LocalAI.

## What is your repo built with?

Any public repo, with no account: https://seerepo.com/r/owner/repo/built, with the owner and name it has on GitHub.
