train-llm-from-scratch vs ColossalAI
train-llm-from-scratch and ColossalAI share 5 technologies: torchaudio, torchvision, torch, tiktoken, and datasets. Both are written in Python.
What they share and what sets them apart
FareedKhan-dev
train-llm-from-scratch
A straightforward method for training your LLM, from downloading data to generating text.
Python13.2kRead on November 10, 2026, at commit bdd480aWhat is train-llm-from-scratch built with?Only in train-llm-from-scratch
h5py
In common
hpcaitech
ColossalAI
Making large AI models cheaper, faster and more accessible
Python41.4kRead on November 6, 2026, at commit da8f5c2What is ColossalAI built with?Only in ColossalAI
- FastAPI
uvicorn
chromadb
- Hugging Face
- anyio
- Ray
- Gradio
seaborn
matplotlib
- Rich
- SQLAlchemy
- ModelScope
OpenAI- scikit-learn
sentence-transformers
- transformers
- LangChain
- triton
peft
diffusers
- flash-attn
timm
safetensors
- bitsandbytes
- vLLM
- einops
accelerate
- galore-torch
- math-verify
- sentencepiece
tokenizers
- jinja2
markdown-it-py
markupsafe
- mdurl
pypdf
unstructured
pillow
- jsonlines
- annotated-types
- pydantic-core
- Pydantic
psutil
Side by side
train-llm-from-scratchColossalAI
SizeLines written by people and agents, without generated ones; code files, without tests.
train-llm-from-scratch12,346 lines written79 code files
ColossalAI317,403 lines written974 code files
Who writes itA commit counts as AI's when it carries its signature: a Co-Authored-By line, its author name or the merge of its branch.
train-llm-from-scratch7.1% of its commits signed by AIWith Claude Code and GitHub Copilot
ColossalAI0.3% of its commits signed by AIWith Codex and Claude Code
ActivityFrom GitHub and its history, on the day SeeRepo read it.
train-llm-from-scratchLast push October 2, 2026155 commits13,179 stars
ColossalAILast push November 6, 20263,887 commits41,430 stars
TestsThe files that test the code, and the share of code files a test imports.
train-llm-from-scratch26 test files39.2% of its code files have a test that imports them
ColossalAI505 test files1.1% of its code files have a test that imports them
Frequently asked questions
Which is bigger, train-llm-from-scratch or ColossalAI?
ColossalAI, with 317,403 lines written; train-llm-from-scratch has 12,346.
Which has more GitHub stars, train-llm-from-scratch or ColossalAI?
ColossalAI, with 41,430 stars; train-llm-from-scratch has 13,179.
The proof: hpcaitech/ColossalAI on GitHub
Which has more tests, train-llm-from-scratch or ColossalAI?
ColossalAI, with 505 test files; train-llm-from-scratch has 26.
Which was updated more recently, train-llm-from-scratch or ColossalAI?
ColossalAI: its last push was on November 6, 2026, and train-llm-from-scratch's on October 2, 2026.
The proof: hpcaitech/ColossalAI's commits on GitHub
Which has more commits signed by AI, train-llm-from-scratch or ColossalAI?
train-llm-from-scratch: an AI signed 7.1% of its commits, with Claude Code and GitHub Copilot; in ColossalAI, 0.3%.
See inside your code, today.
Paste your repo and see it drawn, part by part: a medium one in under a minute.
Free, no account.

