SeeRepo
Draw my repo

LocalAI vs inference

LocalAI and inference share 36 technologies: React, pyarrow, Hugging Face, OpenAI, anyio, FastAPI, Lightning, uvicorn, matplotlib, accelerate, bitsandbytes, conformer, einops, ModelScope, sentencepiece, tiktoken, torchvision, vector-quantize-pytorch, torch, transformers, diffusers, torchaudio, librosa, onnxruntime, funasr, kokoro, optimum, peft, safetensors, sentence-transformers, torchcodec, pillow, imageio-ffmpeg, loguru, OpenTelemetry, and highlight.js. LocalAI is written in Go and inference in Python.

Read it as markdown

What they share and what sets them apart

mudler

LocalAI

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Go50.3kRead on November 13, 2026, at commit affff71What is LocalAI built with?

Only in LocalAI

In common

xorbitsai

inference

Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.

Python9.7kRead on November 14, 2026, at commit d2607afWhat is inference built with?

Only in inference

Side by side

SizeLines written by people and agents, without generated ones; code files, without tests.
LocalAI1,553,487 lines written3,372 code files
inference922,374 lines written2,727 code files
Who writes itA commit counts as AI's when it carries its signature: a Co-Authored-By line, its author name or the merge of its branch.
LocalAI6% of its commits signed by AIWith Claude Code, GitHub Copilot, and Cursor
inference0.3% of its commits signed by AIWith Gemini CLI, Claude Code, and Cursor
ActivityFrom GitHub and its history, on the day SeeRepo read it.
LocalAILast push November 13, 20269,855 commits50,345 stars
inferenceLast push November 14, 20262,791 commits9,655 stars
TestsThe files that test the code, and the share of code files a test imports.
LocalAI3,400 test files62.5% of its code files have a test that imports them
inference676 test files19.9% of its code files have a test that imports them

Frequently asked questions

Which is bigger, LocalAI or inference?
LocalAI, with 1,553,487 lines written; inference has 922,374.

The proof: mudler/LocalAI's code at commit affff71

Which has more GitHub stars, LocalAI or inference?
LocalAI, with 50,345 stars; inference has 9,655.

The proof: mudler/LocalAI on GitHub

Which has more tests, LocalAI or inference?
LocalAI, with 3,400 test files; inference has 676.

The proof: mudler/LocalAI's code at commit affff71

Which was updated more recently, LocalAI or inference?
inference: its last push was on November 14, 2026, and LocalAI's on November 13, 2026.

The proof: xorbitsai/inference's commits on GitHub

Which has more commits signed by AI, LocalAI or inference?
LocalAI: an AI signed 6% of its commits, with Claude Code, GitHub Copilot, and Cursor; in inference, 0.3%.

The proof: the commits each tool signed in mudler/LocalAI

See inside your code, today.

Paste your repo and see it drawn, part by part: a medium one in under a minute.

Free, no account.

Or look inside SeeRepo's own →