ai-infra-book vs vllm

ai-infra-book and vllm share 39 technologies: FastAPI, gitdb, pyzmq, Hugging Face, starlette, Ray, AIOHTTP, mkdocs-material, apache-tvm-ffi, cuda-python, cupy-cuda13x, flashinfer-python, MCP, mistral-common, nixl, nvidia-cudnn-frontend, OpenAI, sentencepiece, tiktoken, timm, torch, transformers, torchvision, triton, safetensors, einops, torchaudio, cuda-bindings, tokenizers, markupsafe, markdown, pillow, jinja2, annotated-types, msgspec, Pydantic, OpenTelemetry, psutil, and prometheus-client. Both are written in Python.

Read it as markdown

What they share and what sets them apart

bojieli

ai-infra-book

《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验

Python8kRead on November 17, 2026, at commit 3bdcb4fWhat is ai-infra-book built with?

Only in ai-infra-book

In common

vllm-project

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Python97.1kRead on November 17, 2026, at commit 61c3895What is vllm built with?

Only in vllm

  • axum
  • Tokio
  • tower
  • indicatif
  • AMD
  • auto-round-lib
  • conch-triton-kernels
  • cupy-cuda12x
  • humming-kernels
  • lm-format-enforcer
  • mooncake-transfer-engine
  • mooncake-transfer-engine-rocm
  • NVIDIA
  • openai-harmony
  • oss-harmony
  • quack-kernels
  • vllm-bench
  • vllm-chat
  • vllm-engine-core-client
  • vllm-llm
  • vllm-managed-engine
  • vllm-parser
  • vllm-proto
  • vllm-server
  • vllm-text
  • vllm-tokenizer
  • xgrammar-structural-tag
  • llm-multimodal
  • compressed-tensors
  • xgrammar
  • partial-json-parser
  • lmcache
  • vllm-xpu-kernels
  • runai-model-streamer
  • tokenspeed-mla
  • llguidance
  • outlines-core
  • tpu-inference
  • fastokens
  • fastsafetensors
  • hf-hub
  • instanttensor
  • riptoken
  • tekken
  • tensorizer
  • tiktoken-rs
  • mkdocs-material-extensions
  • parquet
  • properdocs
  • pymdown-extensions
  • selectolax
  • xlsxwriter
  • image
  • minijinja
  • torchcodec
  • minijinja-contrib
  • validator
  • opentelemetry-semantic-conventions-ai
  • python-json-logger
  • vllm-metrics
  • vllm-tracing
  • tracing
  • tracing-futures
  • tracing-subscriber
  • model-hosting-container-standards
  • prometheus-fastapi-instrumentator
  • tracing-log

Side by side

SizeLines written by people and agents, without generated ones; code files, without tests.
ai-infra-book1,438,355 lines written1,748 code files
vllm2,606,460 lines written3,630 code files
Who writes itA commit counts as AI's when it carries its signature: a Co-Authored-By line, its author name or the merge of its branch.
ai-infra-book16.6% of its commits signed by AIWith Claude Code and Codex
vllm14.7% of its commits signed by AIWith Claude Code, Codex, Gemini CLI, Cursor, GitHub Copilot, Devin, Mistral Vibe, CodeRabbit, Factory, and Qwen Code
ActivityFrom GitHub and its history, on the day SeeRepo read it.
ai-infra-bookLast push October 1, 2026314 commits8,032 stars
vllmLast push November 17, 202625,558 commits97,060 stars
TestsThe files that test the code, and the share of code files a test imports.
ai-infra-book1,093 test files17.8% of its code files have a test that imports them
vllm2,586 test files60.7% of its code files have a test that imports them

Frequently asked questions

Which is bigger, ai-infra-book or vllm?
vllm, with 2,606,460 lines written; ai-infra-book has 1,438,355.

The proof: vllm-project/vllm's code at commit 61c3895

Which has more GitHub stars, ai-infra-book or vllm?
vllm, with 97,060 stars; ai-infra-book has 8,032.

The proof: vllm-project/vllm on GitHub

Which has more tests, ai-infra-book or vllm?
vllm, with 2,586 test files; ai-infra-book has 1,093.

The proof: vllm-project/vllm's code at commit 61c3895

Which was updated more recently, ai-infra-book or vllm?
vllm: its last push was on November 17, 2026, and ai-infra-book's on October 1, 2026.

The proof: vllm-project/vllm's commits on GitHub

Which has more commits signed by AI, ai-infra-book or vllm?
ai-infra-book: an AI signed 16.6% of its commits, with Claude Code and Codex; in vllm, 14.7%.

The proof: the commits each tool signed in bojieli/ai-infra-book

See inside your code, today.

Paste your repo and see it drawn, part by part: a medium one in under a minute.

Free, no account.Private repo? Sign in with GitHub

Or look inside SeeRepo's own →