unsloth vs inference
unsloth and inference share 32 technologies: React, FastAPI, Hugging Face, OpenAI, uvicorn, anyio, torch, transformers, peft, accelerate, safetensors, sentence-transformers, gguf, librosa, pillow, Pydantic, psutil, matplotlib, descript-audiotools, einops, julius, sentencepiece, tiktoken, timm, diffusers, loguru, class-variance-authority, Tailwind CSS, tailwind-merge, Radix UI, sonner, and Lucide. Both are written in Python.
What they share and what sets them apart
unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
Python79.4kRead on November 12, 2026, at commit 98836c2What is unsloth built with?Only in unsloth
- sqlite-vec
usearch
fastmcp
- Tauri
- Tokio
objc2-foundation
glib
objc2-app-kit
gio
- TanStack
- Vite
dexie
- @tauri-apps/api
@assistant-ui/core
- Rich
trl
- datasets
tokenizers
markdown-it-py
pymupdf
- pymupdf4llm
- python-docx
av
- jinja2
structlog
cairo-rs
gtk
tauri-plugin-dialog
- webkit2gtk
- webview2-com
gdk
objc2-web-kit
tauri-plugin-window-state
- webkit2gtk-sys
tauri-plugin-notification
- cryptography
- hmac
- pyjwt
- cut-cross-entropy
descript-audio-codec
- einx
- jiwer
numkong
openai-whisper
- pystoi
- scikit-learn
- torch-c-dlpack-ext
- torch-stoi
- triton-kernels
- data-designer-engine
snac
kernels
- spandrel
- markdown2
- mdurl
gdk-pixbuf
lxml
- log
- simplelog
- PostCSS
- @tailwindcss/vite
postcss-selector-parser
- xyflow
motion
- @streamdown/code
recharts
- cmdk
- canvas-confetti
react-day-picker
react-resizable-panels
@dagrejs/dagre
@tauri-apps/plugin-notification
- Base UI
hugeicons
@assistant-ui/react
assistant-stream
- streamdown
- mdast-util-from-markdown
- mdast-util-gfm
- mdast-util-math
micromark-extension-gfm
micromark-extension-math
unified
katex
- remend
- js-yaml
- mammoth
marked
- react-pdf
react-qr-code
- decode-named-character-reference
- dingbat-to-unicode
micromark-util-types
- unpdf
@tauri-apps/plugin-process
In common
inference
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
Python9.7kRead on November 14, 2026, at commit d2607afWhat is inference built with?Only in inference
pyarrow
- Lightning
- AIOHTTP
- Next.js
- python-jose
- bcrypt
- en-core-web-sm
- misaki
opencv-contrib-python-headless
- pynini
- transformers-stream-generator
- wetextprocessing
torchaudio
torchvision
- ModelScope
- onnxruntime
- x-transformers
- qwen-vl-utils
funasr
- bitsandbytes
- loralib
- pyworld
- flagembedding
- gruut
- kokoro
- silero-vad
- torchdiffeq
- vector-quantize-pytorch
- vocos
- conformer
- controlnet-aux
fugashi
- g2p-en
- langdetect
optimum
- tensorizer
- eva-decord
imageio-ffmpeg
- torchcodec
- jsonschema
opentelemetry-instrumentation-httpx
- boto3
- OpenTelemetry
opentelemetry-exporter-otlp-proto-grpc
opentelemetry-instrumentation-fastapi
- next-themes
react-icons
highlight.js
- Nunjucks
- react-markdown
rehype-katex
rehype-raw
rehype-sanitize
remark-gfm
remark-math
Side by side
Frequently asked questions
Which is bigger, unsloth or inference?
The proof: unslothai/unsloth's code at commit 98836c2
Which has more GitHub stars, unsloth or inference?
The proof: unslothai/unsloth on GitHub
Which has more tests, unsloth or inference?
The proof: unslothai/unsloth's code at commit 98836c2
Which was updated more recently, unsloth or inference?
The proof: xorbitsai/inference's commits on GitHub
Which has more commits signed by AI, unsloth or inference?
The proof: the commits each tool signed in unslothai/unsloth
See inside your code, today.
Paste your repo and see it drawn, part by part: a medium one in under a minute.
Free, no account.

