ai-infra-book vs LocalAI
ai-infra-book and LocalAI share 38 technologies: FastAPI, pyarrow, Hugging Face, anyio, Lightning, uvicorn, Gradio, matplotlib, accelerate, llvmlite, MCP, mlx, mlx-lm, OpenAI, peft, sentencepiece, tiktoken, torch, transformers, torchvision, safetensors, einops, flash-attn, datasets, ONNX, diffusers, librosa, torchaudio, ModelScope, tokenizers, imageio, imageio-ffmpeg, markupsafe, pillow, av, jinja2, OpenTelemetry, and loguru. ai-infra-book is written in Python and LocalAI in Go.
What they share and what sets them apart
ai-infra-book
《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
Python8kRead on November 17, 2026, at commit 3bdcb4fWhat is ai-infra-book built with?Only in ai-infra-book
- blobfile
- gitdb
- huey
- Redis
- s3fs
- s3transfer
- smart-open
tensorboard-data-server
- transferqueue
- pyzmq
- Anthropic
Flask
- flask-cors
- graphene
- graphql-core
- graphql-relay
- hypercorn
- jupyter-core
- kui
quart
starlette
tornado
werkzeug
- Ray
- AIOHTTP
- cycler
mkdocs-material
fonttools
- blessed
contourpy
- kaleido
- matplotlib-inline
Plotly
prompt-toolkit
pyecharts
seaborn
- alembic
- SQLAlchemy
- cryptography
itsdangerous
apache-tvm-ffi
- comet-ml
- cuda-core
- cuda-python
- cuda-toolkit
cupy-cuda13x
- decord2
descript-audio-codec
e2b
- einx
- emerging-optimizers
evaluate
fla-core
flash-linear-attention
flashinfer-cubin
flashinfer-python
jaxlib
- loralib
- mamba-ssm
- math-verify
- megatron-bridge
- mistral-common
- ml-dtypes
- MLflow
mooncake-transfer-engine-cuda13
- nixl
nltk
- nvidia-cublas
- nvidia-cudnn-cu12
- nvidia-cudnn-cu13
nvidia-cudnn-frontend
- nvidia-cufft
- nvidia-cusolver
- nvidia-cusparse
- nvshmem4py-cu13
onnx-ir
onnxscript
- open-clip-torch
openai-agents
- opt-einsum
pythainlp
- qwen-vl-utils
rouge-score
- sacrebleu
- scikit-learn
- sglang-router
- silero-vad
- sklearn-crfsuite
skops
- spaCy
spacy-legacy
stanza
thinc
timm
- torch-c-dlpack-ext
tensordict
- triton
- megatron-core
- xformers
deepspeed
jax
- causal-conv1d
- cuda-bindings
- nvidia-cuda-runtime
- torchdata
- transformer-engine
- cairosvg
- defusedxml
lxml
- mako
markdown-it-py
- mdurl
- nbformat
- pylatexenc
- pytablewriter
- python-magic
- markdown
pymupdf
- annotated-types
- dacite
- fastjsonschema
- jsonschema
- jsonschema-specifications
- pathvalidate
- referencing
- typepy
msgspec
- Pydantic
- aiobotocore
- boto3
- botocore
- colorlog
- docker
- gpustat
- Gunicorn
- opencensus-context
opentelemetry-exporter-prometheus
opentelemetry-semantic-conventions
- spacy-loggers
swanlab
psutil
prometheus-client
In common
FastAPI
pyarrow
- Hugging Face
- anyio
- Lightning
uvicorn
Gradio
matplotlib
accelerate
- llvmlite
- MCP
mlx
- mlx-lm
OpenAIpeft
- sentencepiece
- tiktoken
- torch
- transformers
torchvision
safetensors
- einops
- flash-attn
- datasets
- ONNX
diffusers
librosa
torchaudio
- ModelScope
tokenizers
imageio
imageio-ffmpeg
markupsafe
pillow
av
- jinja2
OpenTelemetry
loguru
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Go50.4kRead on November 18, 2026, at commit bb42108What is LocalAI built with?Only in LocalAI
React
- net/http
Echo
- go-sqlite3
- modernc.org/sqlite
s3
- SQLite
- NATS.io
- Postgres
- github.com/glebarez/sqlite
github.com/valkey-io/valkey-go
- Qdrant
- Tokio
react-router-dom
Vite
- Hono
Electron
- github.com/schollz/progressbar/v3
- gorm.io/gorm
- github.com/nats-io/jwt/v2
- github.com/emersion/go-sasl
- golang.org/x/oauth2
github.com/aws/aws-sdk-go-v2/credentials
github.com/coreos/go-oidc/v3
- github.com/timbutler/zxcvbn
- bitsandbytes
- conformer
- coqui-tts
- go-openai
llama-cpp-python
- Model Context Protocol
- nemo-toolkit
- neucodec
NVIDIA
- oneccl-bind-pt
- onnxruntime-gpu
openai-go
- phonemizer
- rfdetr
- s3tokenizer
scikit-image
- spacy-pkuseg
- texterrors
torchao
- torchtune
- vector-quantize-pytorch
github.com/gpustack/gguf-parser-go
github.com/mudler/nib
- github.com/mudler/cogito
- github.com/mudler/localrecall
opencv-python
insightface
- vLLM
- github.com/yalue/onnxruntime_go
- onnxruntime
- QWen
sglang
- compel
- faster-qwen3-tts
- faster-whisper
funasr
github.com/go-skynet/go-llama.cpp
- github.com/mudler/go-piper
- github.com/streamer45/silero-vad-go
inference
- kokoro
- mlx-audio
moonshine-voice
optimum
- optimum-quanto
- outetts
- pocket-tts
- rerankers
sentence-transformers
speechbrain
- tinygrad
trl
voxcpm
- whisperx
- sox
- torchcodec
github.com/go-audio/wav
github.com/pdfcpu/pdfcpu
- github.com/emersion/go-imap/v2
- github.com/yuin/goldmark
- golang.org/x/image
github.com/charmbracelet/glamour
- github.com/dhowden/tag
- github.com/emersion/go-smtp
github.com/go-pdf/fpdf
github.com/klippa-app/go-pdfium
- github.com/google/jsonschema-go
- github.com/mudler/xlog
- github.com/mudler/go-processmanager
- containerd
- Docker
tracing
github.com/aws/aws-sdk-go-v2
github.com/aws/aws-sdk-go-v2/config
github.com/ipfs/go-log
- github.com/Microsoft/hcsshim
- go.opentelemetry.io/otel/exporters/prometheus
- Prometheus
tracing-subscriber
fontsource-variable
- CodeMirror
- @lezer/highlight
yaml
- dompurify
marked
- docx-preview
highlight.js
xlsx
Side by side
Frequently asked questions
Which is bigger, ai-infra-book or LocalAI?
The proof: mudler/LocalAI's code at commit bb42108
Which has more GitHub stars, ai-infra-book or LocalAI?
The proof: mudler/LocalAI on GitHub
Which has more tests, ai-infra-book or LocalAI?
The proof: mudler/LocalAI's code at commit bb42108
Which was updated more recently, ai-infra-book or LocalAI?
The proof: mudler/LocalAI's commits on GitHub
Which has more commits signed by AI, ai-infra-book or LocalAI?
The proof: the commits each tool signed in bojieli/ai-infra-book
See inside your code, today.
Paste your repo and see it drawn, part by part: a medium one in under a minute.
Free, no account.Private repo? Sign in with GitHub

