What is DataFlow built with?

DataFlow is a Python repo built with FastAPI and uvicorn. It reaches its data with sqlglot, uses AI through accelerate, evaluate, sentencepiece, torchaudio, torchvision, and 13 more, connects to Google, makes its content with lxml-html-clean, pypdf, and pymupdf, validates its data with Pydantic, is tested with Pytest, runs in production with psutil and colorlog, and uses db-dtypes, gcsfs, pyarrow, and pymysql. It has 78,684 written lines, with 83 test files.

Read on November 16, 2026, at commit 13d5de8. Read it as markdown

The card says what it's built with. Its whole map opens it up: every part of the code and how it connects to the rest.

Frontend

Interface 2

Backend

Data 4

Data access 1

AI 17

5 more

Services 2

Support

The base 2

Content 3

Validation 1

Testing 1

  • Pytest52 files

Deploy 2

Tools 2

  • Cookiecutter1 file
  • docstring-parser

Other 23

  • pandas83 files
  • tqdm56 files
  • NumPy37 files
  • pyyaml5 files
  • google-api-core1 file
  • rapidfuzz1 file
  • SciPy1 file
  • trafilatura1 file
  • termcolor
  • requests10 files
  • colorama7 files
  • word2number2 files
11 more
  • appdirs1 file
  • datasketch1 file
  • simhash1 file
  • addict
  • cloudpickle
  • func-timeout
  • httpx
  • json5
  • pyfiglet
  • soundfile
  • sseclient-py

Other repos with a similar stack

Ordered by how much of its stack they share with DataFlow, then by stars.

Frequently asked questions

What language is DataFlow written in?
DataFlow is written in Python, with 78,684 written lines.
What framework does DataFlow use?
DataFlow is built with FastAPI and uvicorn.
Does DataFlow use AI?
Yes. DataFlow uses AI through accelerate, evaluate, sentencepiece, torchaudio, torchvision, torch, transformers, nltk, chonkie, datasets, fasttext, librosa, math-verify, ModelScope, presidio-analyzer, presidio-anonymizer, tiktoken, and OpenAI.
What services does DataFlow use?
DataFlow connects to Google and uses db-dtypes, gcsfs, pyarrow, and pymysql.

The proof: dataflow/serving/api_google_vertexai_serving.py, line 36

Does DataFlow have tests?
Yes. DataFlow has 83 test files and is tested with Pytest.
Which repos have a stack like DataFlow's?
The ones that share most of its stack:run-llama/llama_indexbojieli/ai-agent-bookray-project/ray

See inside your code, today.

Paste your repo and see it drawn, part by part: a medium one in under a minute.

Free, no account.Private repo? Sign in with GitHub

Or look inside SeeRepo's own →

Is it your repo? Add its badge, keep it up to date or take it down →