LlamaFactory vs ms-swift
LlamaFactory and ms-swift share 17 technologies: FastAPI, uvicorn, matplotlib, einops, sentencepiece, tiktoken, torchvision, transformers, datasets, accelerate, trl, peft, safetensors, ModelScope, torchaudio, nltk, and swanlab. Both are written in Python.
What they share and what sets them apart
LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Python76kRead on November 9, 2026, at commit 28462f1What is LlamaFactory built with?Only in LlamaFactory
- Gradio
- aqlm
- eetq
- gptqmodel
hqq
ktransformers
triton-ascend
- vector-quantize-pytorch
- vocos
- torch
- badam
deepspeed
torch-npu
- vLLM
- fsdp-turbo
- liger-kernel
- openmind
- adam-mini
- apollo-torch
- bitsandbytes
- galore-torch
optimum
- rouge-chinese
sglang
torchao
- torchdata
- transformer-engine
- torchcodec
av
- jsonschema-specifications
- referencing
- Pydantic
In common
ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
Python16.1kRead on November 7, 2026, at commit 47b437aWhat is ms-swift built with?Only in ms-swift
- oss2
- Ray
- AIOHTTP
- sphinx-rtd-theme
OpenAI- rouge
- scikit-learn
- docutils
myst-parser
- recommonmark
- sphinx-markdown-tables
pillow
Side by side
Frequently asked questions
Which is bigger, LlamaFactory or ms-swift?
The proof: modelscope/ms-swift's code at commit 47b437a
Which has more GitHub stars, LlamaFactory or ms-swift?
The proof: hiyouga/LlamaFactory on GitHub
Which has more tests, LlamaFactory or ms-swift?
The proof: modelscope/ms-swift's code at commit 47b437a
Which was updated more recently, LlamaFactory or ms-swift?
The proof: hiyouga/LlamaFactory's commits on GitHub
Which has more commits signed by AI, LlamaFactory or ms-swift?
The proof: the commits each tool signed in hiyouga/LlamaFactory
See inside your code, today.
Paste your repo and see it drawn, part by part: a medium one in under a minute.
Free, no account.

