Source: https://seerepo.com/compare/bojieli/ai-infra-book/vs/mudler/LocalAI
Markdown source: https://seerepo.com/compare/bojieli/ai-infra-book/vs/mudler/LocalAI.md
Description: ai-infra-book and LocalAI share 38 technologies: FastAPI, pyarrow, Hugging Face, anyio, Lightning, uvicorn, Gradio, matplotlib, accelerate, llvmlite, MCP, mlx, mlx-lm, OpenAI, peft, sentencepiece, tiktoken, torch, transformers, torchvision, safetensors, einops, flash-attn, datasets, ONNX, diffusers, librosa, torchaudio, ModelScope, tokenizers, imageio, imageio-ffmpeg, markupsafe, pillow, av, jinja2, OpenTelemetry, and loguru. ai-infra-book is written in Python and LocalAI in Go.

# ai-infra-book vs LocalAI

ai-infra-book and LocalAI share 38 technologies: FastAPI, pyarrow, Hugging Face, anyio, Lightning, uvicorn, Gradio, matplotlib, accelerate, llvmlite, MCP, mlx, mlx-lm, OpenAI, peft, sentencepiece, tiktoken, torch, transformers, torchvision, safetensors, einops, flash-attn, datasets, ONNX, diffusers, librosa, torchaudio, ModelScope, tokenizers, imageio, imageio-ffmpeg, markupsafe, pillow, av, jinja2, OpenTelemetry, and loguru. ai-infra-book is written in Python and LocalAI in Go.

- [bojieli/ai-infra-book](https://seerepo.com/r/bojieli/ai-infra-book): 《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
- [mudler/LocalAI](https://seerepo.com/r/mudler/LocalAI): LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

## What they share and what sets them apart

- In common: FastAPI, pyarrow, Hugging Face, anyio, Lightning, uvicorn, Gradio, matplotlib, accelerate, llvmlite, MCP, mlx, mlx-lm, OpenAI, peft, sentencepiece, tiktoken, torch, transformers, torchvision, safetensors, einops, flash-attn, datasets, ONNX, diffusers, librosa, torchaudio, ModelScope, tokenizers, imageio, imageio-ffmpeg, markupsafe, pillow, av, jinja2, OpenTelemetry, loguru
- Only in ai-infra-book: blobfile, gitdb, huey, Redis, s3fs, s3transfer, smart-open, tensorboard-data-server, transferqueue, pyzmq, Anthropic, Flask, flask-cors, graphene, graphql-core, graphql-relay, hypercorn, jupyter-core, kui, quart, starlette, tornado, werkzeug, Ray, AIOHTTP, cycler, mkdocs-material, fonttools, blessed, contourpy, kaleido, matplotlib-inline, Plotly, prompt-toolkit, pyecharts, seaborn, alembic, SQLAlchemy, cryptography, itsdangerous, Google, apache-tvm-ffi, comet-ml, cuda-core, cuda-python, cuda-toolkit, cupy-cuda13x, decord2, descript-audio-codec, e2b, einx, emerging-optimizers, evaluate, fla-core, flash-linear-attention, flashinfer-cubin, flashinfer-python, jaxlib, loralib, mamba-ssm, math-verify, megatron-bridge, mistral-common, ml-dtypes, MLflow, mooncake-transfer-engine-cuda13, nixl, nltk, nvidia-cublas, nvidia-cudnn-cu12, nvidia-cudnn-cu13, nvidia-cudnn-frontend, nvidia-cufft, nvidia-cusolver, nvidia-cusparse, nvshmem4py-cu13, onnx-ir, onnxscript, open-clip-torch, openai-agents, opt-einsum, pythainlp, qwen-vl-utils, rouge-score, sacrebleu, scikit-learn, sglang-router, silero-vad, sklearn-crfsuite, skops, spaCy, spacy-legacy, stanza, thinc, timm, torch-c-dlpack-ext, tensordict, triton, megatron-core, xformers, deepspeed, jax, causal-conv1d, cuda-bindings, nvidia-cuda-runtime, torchdata, transformer-engine, cairosvg, defusedxml, lxml, mako, markdown-it-py, mdurl, nbformat, pylatexenc, pytablewriter, python-magic, markdown, pymupdf, annotated-types, dacite, fastjsonschema, jsonschema, jsonschema-specifications, pathvalidate, referencing, typepy, msgspec, Pydantic, aiobotocore, boto3, botocore, colorlog, docker, gpustat, Gunicorn, opencensus-context, opentelemetry-exporter-prometheus, opentelemetry-semantic-conventions, spacy-loggers, swanlab, psutil, prometheus-client
- Only in LocalAI: React, net/http, Echo, go-sqlite3, modernc.org/sqlite, s3, SQLite, NATS.io, Postgres, github.com/glebarez/sqlite, github.com/valkey-io/valkey-go, Qdrant, Tokio, react-router-dom, Vite, Hono, Electron, github.com/schollz/progressbar/v3, gorm.io/gorm, github.com/nats-io/jwt/v2, github.com/emersion/go-sasl, golang.org/x/oauth2, github.com/aws/aws-sdk-go-v2/credentials, github.com/coreos/go-oidc/v3, github.com/timbutler/zxcvbn, bitsandbytes, conformer, coqui-tts, go-openai, llama-cpp-python, Model Context Protocol, nemo-toolkit, neucodec, NVIDIA, oneccl-bind-pt, onnxruntime-gpu, openai-go, phonemizer, rfdetr, s3tokenizer, scikit-image, spacy-pkuseg, texterrors, torchao, torchtune, vector-quantize-pytorch, github.com/gpustack/gguf-parser-go, github.com/mudler/nib, github.com/mudler/cogito, github.com/mudler/localrecall, opencv-python, insightface, vLLM, github.com/yalue/onnxruntime_go, onnxruntime, QWen, sglang, compel, faster-qwen3-tts, faster-whisper, funasr, github.com/go-skynet/go-llama.cpp, github.com/mudler/go-piper, github.com/streamer45/silero-vad-go, inference, kokoro, mlx-audio, moonshine-voice, optimum, optimum-quanto, outetts, pocket-tts, rerankers, sentence-transformers, speechbrain, tinygrad, trl, voxcpm, whisperx, sox, torchcodec, github.com/go-audio/wav, github.com/pdfcpu/pdfcpu, github.com/emersion/go-imap/v2, github.com/yuin/goldmark, golang.org/x/image, github.com/charmbracelet/glamour, github.com/dhowden/tag, github.com/emersion/go-smtp, github.com/go-pdf/fpdf, github.com/klippa-app/go-pdfium, github.com/google/jsonschema-go, github.com/mudler/xlog, github.com/mudler/go-processmanager, containerd, Docker, tracing, github.com/aws/aws-sdk-go-v2, github.com/aws/aws-sdk-go-v2/config, github.com/ipfs/go-log, github.com/Microsoft/hcsshim, go.opentelemetry.io/otel/exporters/prometheus, Prometheus, tracing-subscriber, fontsource-variable, CodeMirror, @lezer/highlight, yaml, dompurify, marked, docx-preview, highlight.js, xlsx

## Side by side

| | ai-infra-book | LocalAI |
|---|---|---|
| Size | 1,438,355 lines written, 1,748 code files | 1,664,476 lines written, 3,682 code files |
| Who writes it | 16.6% of its commits signed by AI. With Claude Code and Codex | 6.6% of its commits signed by AI. With Claude Code, GitHub Copilot, and Cursor |
| Activity | Last push October 1, 2026, 314 commits, 8,032 stars | Last push November 18, 2026, 10,101 commits, 50,425 stars |
| Tests | 1,093 test files. 17.8% of its code files have a test that imports them | 3,671 test files. 62.1% of its code files have a test that imports them |

- Size: Lines written by people and agents, without generated ones; code files, without tests.
- Who writes it: A commit counts as AI's when it carries its signature: a Co-Authored-By line, its author name or the merge of its branch.
- Activity: From GitHub and its history, on the day SeeRepo read it.
- Tests: The files that test the code, and the share of code files a test imports.

## Frequently asked questions

### Which is bigger, ai-infra-book or LocalAI?

LocalAI, with 1,664,476 lines written; ai-infra-book has 1,438,355.

The proof: [mudler/LocalAI's code at commit bb42108](https://github.com/mudler/LocalAI/tree/bb421089ecc58c1be557440effb22f720db351f0)

### Which has more GitHub stars, ai-infra-book or LocalAI?

LocalAI, with 50,425 stars; ai-infra-book has 8,032.

The proof: [mudler/LocalAI on GitHub](https://github.com/mudler/LocalAI)

### Which has more tests, ai-infra-book or LocalAI?

LocalAI, with 3,671 test files; ai-infra-book has 1,093.

The proof: [mudler/LocalAI's code at commit bb42108](https://github.com/mudler/LocalAI/tree/bb421089ecc58c1be557440effb22f720db351f0)

### Which was updated more recently, ai-infra-book or LocalAI?

LocalAI: its last push was on November 18, 2026, and ai-infra-book's on October 1, 2026.

The proof: [mudler/LocalAI's commits on GitHub](https://github.com/mudler/LocalAI/commits)

### Which has more commits signed by AI, ai-infra-book or LocalAI?

ai-infra-book: an AI signed 16.6% of its commits, with Claude Code and Codex; in LocalAI, 6.6%.

The proof: [the commits each tool signed in bojieli/ai-infra-book](https://seerepo.com/r/bojieli/ai-infra-book/ai)

## Sources

- bojieli/ai-infra-book: Read on November 17, 2026, at commit 3bdcb4f (https://github.com/bojieli/ai-infra-book/tree/3bdcb4fcab73010eeaccf31cc10a8242a895d82e)
- mudler/LocalAI: Read on November 18, 2026, at commit bb42108 (https://github.com/mudler/LocalAI/tree/bb421089ecc58c1be557440effb22f720db351f0)

## What is your repo built with?

Any public repo, with no account: https://seerepo.com/r/owner/repo/built, with the owner and name it has on GitHub.
