Source: https://seerepo.com/compare/hpcaitech/ColossalAI/vs/OpenDCAI/DataFlow
Markdown source: https://seerepo.com/compare/hpcaitech/ColossalAI/vs/OpenDCAI/DataFlow.md
Description: ColossalAI and DataFlow share 18 technologies: FastAPI, uvicorn, Gradio, Rich, ModelScope, OpenAI, tiktoken, torch, transformers, datasets, accelerate, math-verify, sentencepiece, torchaudio, torchvision, pypdf, Pydantic, and psutil. Both are written in Python.

# ColossalAI vs DataFlow

ColossalAI and DataFlow share 18 technologies: FastAPI, uvicorn, Gradio, Rich, ModelScope, OpenAI, tiktoken, torch, transformers, datasets, accelerate, math-verify, sentencepiece, torchaudio, torchvision, pypdf, Pydantic, and psutil. Both are written in Python.

- [hpcaitech/ColossalAI](https://seerepo.com/r/hpcaitech/ColossalAI): Making large AI models cheaper, faster and more accessible
- [OpenDCAI/DataFlow](https://seerepo.com/r/OpenDCAI/DataFlow): [SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

## What they share and what sets them apart

- In common: FastAPI, uvicorn, Gradio, Rich, ModelScope, OpenAI, tiktoken, torch, transformers, datasets, accelerate, math-verify, sentencepiece, torchaudio, torchvision, pypdf, Pydantic, psutil
- Only in ColossalAI: chromadb, Hugging Face, anyio, Ray, seaborn, matplotlib, SQLAlchemy, rouge, scikit-learn, sentence-transformers, colossalai, LangChain, triton, peft, diffusers, flash-attn, safetensors, bitsandbytes, vLLM, einops, galore-torch, loralib, jinja2, markdown-it-py, markupsafe, mdurl, unstructured, pillow, jsonlines, annotated-types, gpustat, fabric
- Only in DataFlow: db-dtypes, gcsfs, pyarrow, pymysql, Google, sqlglot, evaluate, nltk, chonkie, fasttext, librosa, presidio-analyzer, presidio-anonymizer, lxml-html-clean, pymupdf, colorlog

## Side by side

| | ColossalAI | DataFlow |
|---|---|---|
| Size | 319,283 lines written, 975 code files | 78,684 lines written, 317 code files |
| Who writes it | 0.3% of its commits signed by AI. With Codex and Claude Code | 0.2% of its commits signed by AI. With Claude Code and GitHub Copilot |
| Activity | Last push November 13, 2026, 3,904 commits, 41,424 stars | Last push November 16, 2026, 999 commits, 8,607 stars |
| Tests | 515 test files. 1.1% of its code files have a test that imports them | 83 test files. 14.8% of its code files have a test that imports them |

- Size: Lines written by people and agents, without generated ones; code files, without tests.
- Who writes it: A commit counts as AI's when it carries its signature: a Co-Authored-By line, its author name or the merge of its branch.
- Activity: From GitHub and its history, on the day SeeRepo read it.
- Tests: The files that test the code, and the share of code files a test imports.

## Frequently asked questions

### Which is bigger, ColossalAI or DataFlow?

ColossalAI, with 319,283 lines written; DataFlow has 78,684.

The proof: [hpcaitech/ColossalAI's code at commit 297c8cf](https://github.com/hpcaitech/ColossalAI/tree/297c8cf6d91cb0bff795cba961d3aea1e66fa370)

### Which has more GitHub stars, ColossalAI or DataFlow?

ColossalAI, with 41,424 stars; DataFlow has 8,607.

The proof: [hpcaitech/ColossalAI on GitHub](https://github.com/hpcaitech/ColossalAI)

### Which has more tests, ColossalAI or DataFlow?

ColossalAI, with 515 test files; DataFlow has 83.

The proof: [hpcaitech/ColossalAI's code at commit 297c8cf](https://github.com/hpcaitech/ColossalAI/tree/297c8cf6d91cb0bff795cba961d3aea1e66fa370)

### Which was updated more recently, ColossalAI or DataFlow?

DataFlow: its last push was on November 16, 2026, and ColossalAI's on November 13, 2026.

The proof: [OpenDCAI/DataFlow's commits on GitHub](https://github.com/OpenDCAI/DataFlow/commits)

### Which has more commits signed by AI, ColossalAI or DataFlow?

ColossalAI: an AI signed 0.3% of its commits, with Codex and Claude Code; in DataFlow, 0.2%.

## Sources

- hpcaitech/ColossalAI: Read on November 13, 2026, at commit 297c8cf (https://github.com/hpcaitech/ColossalAI/tree/297c8cf6d91cb0bff795cba961d3aea1e66fa370)
- OpenDCAI/DataFlow: Read on November 16, 2026, at commit 13d5de8 (https://github.com/OpenDCAI/DataFlow/tree/13d5de84ad151c0bfc434167d9e3b9e36c3809e4)

## What is your repo built with?

Any public repo, with no account: https://seerepo.com/r/owner/repo/built, with the owner and name it has on GitHub.
