What is DeepSpeed built with?

Q: Which repos have a stack like DeepSpeed's?

The ones that share most of its stack: ray-project/ray, vllm-project/vllm, and unslothai/unsloth.

DeepSpeed is a Python repo. It uses AI through accelerate, sentencepiece, torch, transformers, triton, and 8 more, makes its content with docutils, validates its data with Pydantic, is tested with pytest-forked, pytest-xdist, and Pytest, and deploys with psutil. It has 247,033 written lines, with 395 test files.

Read on November 6, 2026, at commit f47dc3e. Read it as markdown

Frontend

Styles 1

sphinx-rtd-theme

Backend

AI 13

torch397 files
diffusers3 files
safetensors3 files
lm-eval1 file
torchvision1 file
accelerate
transformers28 files
triton11 files
einops4 files
comet-ml2 files
liger-kernel1 file
xgboost1 file

1 more

sentencepiece

Support

Content 1

docutils

Validation 1

Pydantic12 files

Testing 3

Pytest291 files
pytest-xdist
pytest-forked

Deploy 1

psutil7 files

Tools 7

tensorboard1 file
ninja
pre-commit
Sphinx
packaging21 files
autodoc-pydantic
clang-format

Other 11

NumPy12 files
tqdm4 files
wandb2 files
msgpack1 file
SciPy1 file
hjson5 files
tabulate1 file
future
importlib-metadata
protobuf
py-cpuinfo

Other repos with a similar stack

Ordered by how much of its stack they share with DeepSpeed, then by stars.

ray-projectray
44.2k
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
14 of 38 in commonCompare →
vllm-projectvllm
96.3k
A high-throughput and memory-efficient inference and serving engine for LLMs
9 of 38 in commonCompare →
unslothaiunsloth
79.1k
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
9 of 38 in commonCompare →
hiyougaLlamaFactory
75.9k
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
9 of 38 in commonCompare →
mudlerLocalAI
50.2k
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
8 of 38 in common · GoCompare →
gradio-appgradio
44k
Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
8 of 38 in commonCompare →

Frequently asked questions

What language is DeepSpeed written in?

DeepSpeed is written in Python, with 247,033 written lines.

Does DeepSpeed use AI?

Yes. DeepSpeed uses AI through accelerate, sentencepiece, torch, transformers, triton, einops, diffusers, safetensors, comet-ml, liger-kernel, lm-eval, torchvision, and xgboost.

Does DeepSpeed have tests?

Yes. DeepSpeed has 395 test files and is tested with pytest-forked, pytest-xdist, and Pytest.

Which repos have a stack like DeepSpeed's?

The ones that share most of its stack:ray-project/ray vllm-project/vllm unslothai/unsloth