What is datahub built with?

datahub is a Python repo built with FastAPI, Spring, pyspark, AIOHTTP, anyio, and 5 more. It stores its data in org.springframework.kafka:spring-kafka and org.apache.iceberg:iceberg-core, signs people in with org.springframework.security:spring-security-oauth2-jose, software.amazon.awssdk:sts, and com.google.auth:google-auth-library-oauth2-http, stores files in AWS S3, uses AI through software.amazon.awssdk:bedrockruntime, watches its errors with Sentry, connects to Google, makes its content with velocity-engine-core, beautifulsoup4, dompurify, js-yaml, html-to-image, and 3 more, validates its data with Pydantic, jsonschema, and io.swagger.parser.v3:swagger-parser, is tested with Pytest, Vitest, and Testing Library, deploys with log4j-core, loguru, org.apache.logging.log4j:log4j-jul, python-json-logger, slf4j-log4j12, and 7 more, and uses s3, spark-sql_2.12, org.apache.iceberg:iceberg-aws, Google Cloud Storage, and Mixpanel. It has 2,991,794 written lines, with 5,307 test files.

Read on November 10, 2026, at commit 0d9b954. Read it as markdown

Frontend

Interface 18

6 more

The base 5

Styles 2

Icons 2

Backend

The base 2

Data 5

  • org.springframework.kafka:spring-kafka23 files
  • org.apache.iceberg:iceberg-core18 files
  • org.apache.iceberg:iceberg-aws1 file
  • s3
  • spark-sql_2.12

Sign-in 3

  • com.google.auth:google-auth-library-oauth2-http1 file
  • org.springframework.security:spring-security-oauth2-jose
  • software.amazon.awssdk:sts4 files

AI 1

  • software.amazon.awssdk:bedrockruntime1 file

Services 5

Support

The base 3

Content 8

Validation 3

Testing 3

  • Pytest1,224 files
  • Vitest448 files
  • Testing Library396 files

Deploy 12

Tools 10

  • click54 files
  • sql-formatter1 file
  • com.google.googlejavaformat:google-java-format
  • Ruff
  • org.projectlombok:lombok1,728 files
  • typing-extensions118 files
  • packaging11 files
  • typing-inspect3 files
  • mypy
  • pip

Other 72

  • i18next146 files
  • Lodash67 files
  • @apollo/client53 files
  • urllib331 files
  • GraphQL25 files
  • python-dateutil15 files
  • avro8 files
  • ruamel.yaml8 files
  • uuid8 files
  • js-cookie6 files
  • OpenTelemetry3 files
  • colorthief2 files
60 more
  • dayjs2 files
  • fuse.js2 files
  • web-vitals2 files
  • analytics1 file
  • Apache1 file
  • requests-file1 file
  • com.google.guava:guava
  • org.apache.commons:commons-configuration2
  • pyyaml
  • react-i18next1,024 files
  • com.fasterxml.jackson.core:jackson-databind279 files
  • requests111 files
  • com.fasterxml.jackson.core:jackson-core83 files
  • query-string52 files
  • jakarta.annotation:jakarta.annotation-api33 files
  • humanfriendly13 files
  • com.fasterxml.jackson.dataformat:jackson-dataformat-yaml10 files
  • tenacity10 files
  • yamljs8 files
  • tabulate6 files
  • color-hash4 files
  • jsonref4 files
  • cached-property3 files
  • deepmerge3 files
  • deprecated3 files
  • diff2 files
  • ijson2 files
  • info.picocli:picocli2 files
  • org.apache.commons:commons-compress2 files
  • cramjam1 file
  • cronstrue1 file
  • graphql-tag1 file
  • net.objecthunter:exp4j1 file
  • node-sql-parser1 file
  • org.xerial.snappy:snappy-java1 file
  • python-dotenv1 file
  • toml1 file
  • aircompressor
  • commons-beanutils
  • commons-collections
  • commons-io
  • dnsjava
  • httpcore5
  • jackson-annotations
  • jackson-dataformat-cbor
  • jaxb-api
  • jaxb-runtime
  • jline
  • json-patch
  • netty-all
  • netty-codec
  • netty-codec-smtp
  • netty-handler
  • netty-resolver-dns-native-macos
  • netty-transport-native-epoll
  • netty-transport-native-kqueue
  • netty-transport-native-unix-common
  • okhttp
  • reactor-netty-core
  • reactor-netty-http

Other repos with a similar stack

Ordered by how much of its stack they share with datahub, then by stars.

Frequently asked questions

What language is datahub written in?
datahub is written in Python, with 2,991,794 written lines.
What framework does datahub use?
datahub is built with FastAPI, Spring, pyspark, AIOHTTP, anyio, React, react-router-dom, React Router, history, and Vite.
What database does datahub use?
datahub stores its data in org.springframework.kafka:spring-kafka and org.apache.iceberg:iceberg-core.
What does datahub sign people in with?
datahub signs people in with org.springframework.security:spring-security-oauth2-jose, software.amazon.awssdk:sts, and com.google.auth:google-auth-library-oauth2-http.
Does datahub use AI?
Yes. datahub uses AI through software.amazon.awssdk:bedrockruntime.
What services does datahub use?
datahub stores files in AWS S3, watches its errors with Sentry, connects to Google, and uses s3, spark-sql_2.12, org.apache.iceberg:iceberg-aws, Google Cloud Storage, and Mixpanel.

The proof: metadata-service/factories/src/main/java/com/linkedin/gms/factory/objectstorage/ObjectStorageClientFactory.java, line 23

Does datahub have tests?
Yes. datahub has 5,307 test files and is tested with Pytest, Vitest, and Testing Library.
Which repos have a stack like datahub's?

See inside your code, today.

Paste your repo and see it drawn, part by part: a medium one in under a minute.

Free, no account.

Or look inside SeeRepo's own →

Is it your repo? Add its badge, keep it up to date or take it down →