What is DataFlow built with?
DataFlow is a Python repo built with FastAPI and uvicorn. It reaches its data with sqlglot, uses AI through accelerate, evaluate, sentencepiece, torchaudio, torchvision, and 13 more, connects to Google, makes its content with lxml-html-clean, pypdf, and pymupdf, validates its data with Pydantic, is tested with Pytest, runs in production with psutil and colorlog, and uses db-dtypes, gcsfs, pyarrow, and pymysql. It has 78,684 written lines, with 83 test files.
Read on November 16, 2026, at commit 13d5de8. Read it as markdown
The card says what it's built with. Its whole map opens it up: every part of the code and how it connects to the rest.
Frontend
Backend
Data access 1
AI 17
- torch10 files
nltk4 files
chonkie2 files
fasttext1 file
librosa1 file
- ModelScope1 file
presidio-analyzer1 file
presidio-anonymizer1 file
accelerate
evaluate
torchaudio
torchvision
- transformers10 files
- datasets1 file
- math-verify1 file
- tiktoken1 file
- sentencepiece
Services 2
Other repos with a similar stack
Ordered by how much of its stack they share with DataFlow, then by stars.
- run-llamallama_index52.9k
LlamaIndex is the document processing platform for AI

21 of 60 in commonCompare → - bojieliai-agent-book57.9k
《深入理解 AI Agent:设计原理与工程实践》(李博杰 著)开源主仓库:全书正文、编译版 PDF 与按章配套代码

20 of 60 in commonCompare → - hpcaitechColossalAI41.4k
Making large AI models cheaper, faster and more accessible

18 of 60 in commonCompare → - debpalashVoiceStudio111.9k
VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.

16 of 60 in commonCompare →
Frequently asked questions
What language is DataFlow written in?
What framework does DataFlow use?
Does DataFlow use AI?
What services does DataFlow use?
The proof: dataflow/serving/api_google_vertexai_serving.py, line 36
Does DataFlow have tests?
Which repos have a stack like DataFlow's?
See inside your code, today.
Paste your repo and see it drawn, part by part: a medium one in under a minute.
Free, no account.Private repo? Sign in with GitHub
Is it your repo? Add its badge, keep it up to date or take it down →

