Source: https://seerepo.com/r/airbytehq/airbyte/built
Markdown source: https://seerepo.com/r/airbytehq/airbyte/built.md
Description: airbyte is a Kotlin repo built with javax.ws.rs-api, JetBrains, jakarta.inject:jakarta.inject-api, and io.micronaut:micronaut-inject.

# What is airbyte built with?

airbyte is a Kotlin repo built with javax.ws.rs-api, JetBrains, jakarta.inject:jakarta.inject-api, and io.micronaut:micronaut-inject. It stores its data in Postgres, MySQL, com.zaxxer:HikariCP, pyarrow, duckdb-engine, and 1 more, reaches it with org.jooq:jooq and SQLAlchemy, signs people in with google-auth-oauthlib, google-auth, com.google.auth:google-auth-library-oauth2-http, software.amazon.awssdk:sts, pyjwt, and 1 more, stores files in AWS S3, uses AI through fastembed, onnxruntime, and transformers, connects to Google, makes its content with beautifulsoup4, html5lib, jsoup, lxml, pyxlsb, and 6 more, validates its data with cattrs, jakarta.validation-api, and marshmallow, is tested with Pytest and mimesis, deploys with log4j-over-slf4j, log4j-slf4j-impl, org.apache.logging.log4j:log4j-slf4j2-impl, org.slf4j:slf4j-api, boto3, and 3 more, and uses ClickHouse, client-v2, com.mysql:mysql-connector-j, jedis, kafka-clients, and 19 more. It has 770,512 written lines, with 3,555 test files.

Read on November 5, 2026, at commit 39fa89b.

Repository: https://github.com/airbytehq/airbyte

## Frontend

### Interface

- **[Rich](https://seerepo.com/uses/rich)**

## Backend

### Data

- **ClickHouse**
- **client-v2**
- **com.mysql:mysql-connector-j**
- **jedis**
- **kafka-clients**
- **org.mongodb:mongodb-driver-sync**
- **pgvector**
- **PostgreSQL**
- **s3**
- **url-connection-client**
- **weaviate-client**
- **zookeeper**
- **[Postgres](https://seerepo.com/uses/postgres)**: 10 files · [airbyte-integrations/connectors/destination-pgvector/destination_pgvector/pgvector_processor.py, line 26](https://github.com/airbytehq/airbyte/blob/39fa89b97929ff6646ae4d5192170e84b411a333/airbyte-integrations/connectors/destination-pgvector/destination_pgvector/pgvector_processor.py#L26)
- **[MySQL](https://seerepo.com/uses/mysql)**: 7 files · [airbyte-integrations/connectors/source-mysql/src/main/kotlin/io/airbyte/integrations/source/mysql/MySqlSourceOperations.kt, line 6](https://github.com/airbytehq/airbyte/blob/39fa89b97929ff6646ae4d5192170e84b411a333/airbyte-integrations/connectors/source-mysql/src/main/kotlin/io/airbyte/integrations/source/mysql/MySqlSourceOperations.kt#L6)
- **com.zaxxer:HikariCP**: 6 files
- **[pyarrow](https://seerepo.com/uses/pyarrow)**: 3 files
- **[Redis](https://seerepo.com/uses/redis)**: 3 files · [airbyte-integrations/connectors/destination-redis/src/main/java/io/airbyte/integrations/destination/redis/RedisHCache.java, line 12](https://github.com/airbytehq/airbyte/blob/39fa89b97929ff6646ae4d5192170e84b411a333/airbyte-integrations/connectors/destination-redis/src/main/java/io/airbyte/integrations/destination/redis/RedisHCache.java#L12)
- **duckdb-engine**: 2 files
- **[MongoDB](https://seerepo.com/uses/mongodb)**: 2 files · [airbyte-cdk/java/airbyte-cdk/datastore-mongo/build.gradle, line 27](https://github.com/airbytehq/airbyte/blob/39fa89b97929ff6646ae4d5192170e84b411a333/airbyte-cdk/java/airbyte-cdk/datastore-mongo/build.gradle#L27)
- **chromadb**: 1 file
- **databend-sqlalchemy**: 1 file
- **DuckDB**: 1 file
- **pika**: 1 file
- **pymilvus**: 1 file

### Data access

- **org.jooq:jooq**: 18 files
- **[SQLAlchemy](https://seerepo.com/uses/sqlalchemy)**: 6 files

### Sign-in

- **google-auth-oauthlib**
- **google-auth**: 12 files
- **com.google.auth:google-auth-library-oauth2-http**: 8 files
- **software.amazon.awssdk:sts**: 4 files
- **[pyjwt](https://seerepo.com/uses/pyjwt)**: 3 files
- **[cryptography](https://seerepo.com/uses/cryptography)**: 2 files

### AI

- **fastembed**
- **[onnxruntime](https://seerepo.com/uses/onnxruntime)**
- **[transformers](https://seerepo.com/uses/transformers)**

### Services

- **[Google](https://seerepo.com/uses/google)**: 35 files · [airbyte-integrations/connectors/source-google-directory/source_google_directory/api.py, line 1](https://github.com/airbytehq/airbyte/blob/39fa89b97929ff6646ae4d5192170e84b411a333/airbyte-integrations/connectors/source-google-directory/source_google_directory/api.py#L1)
- **Kafka**: 9 files · [airbyte-cdk/bulk/toolkits/extract-cdc/src/main/kotlin/io/airbyte/cdk/read/cdc/DebeziumStateFilesAccessor.kt, line 21](https://github.com/airbytehq/airbyte/blob/39fa89b97929ff6646ae4d5192170e84b411a333/airbyte-cdk/bulk/toolkits/extract-cdc/src/main/kotlin/io/airbyte/cdk/read/cdc/DebeziumStateFilesAccessor.kt#L21)
- **[AWS S3](https://seerepo.com/uses/aws-s3)**: 7 files · [airbyte-cdk/bulk/toolkits/load-fusion/src/main/kotlin/io/airbyte/cdk/fusion/S3FusionUploader.kt, line 10](https://github.com/airbytehq/airbyte/blob/39fa89b97929ff6646ae4d5192170e84b411a333/airbyte-cdk/bulk/toolkits/load-fusion/src/main/kotlin/io/airbyte/cdk/fusion/S3FusionUploader.kt#L10)
- **Elasticsearch**: 4 files · [airbyte-integrations/connectors/destination-elasticsearch-strict-encrypt/src/main/java/io/airbyte/integrations/destination/elasticsearch/ElasticsearchStrictEncryptDestination.java, line 7](https://github.com/airbytehq/airbyte/blob/39fa89b97929ff6646ae4d5192170e84b411a333/airbyte-integrations/connectors/destination-elasticsearch-strict-encrypt/src/main/java/io/airbyte/integrations/destination/elasticsearch/ElasticsearchStrictEncryptDestination.java#L7)
- **Google Cloud Storage**: 4 files · [airbyte-integrations/connectors/source-file/source_file/client.py, line 1](https://github.com/airbytehq/airbyte/blob/39fa89b97929ff6646ae4d5192170e84b411a333/airbyte-integrations/connectors/source-file/source_file/client.py#L1)
- **Couchbase**: 3 files · [airbyte-integrations/connectors/destination-couchbase/destination_couchbase/destination.py, line 11](https://github.com/airbytehq/airbyte/blob/39fa89b97929ff6646ae4d5192170e84b411a333/airbyte-integrations/connectors/destination-couchbase/destination_couchbase/destination.py#L11)
- **[Firebase](https://seerepo.com/uses/firebase)**: 1 file · [airbyte-integrations/connectors/source-firebase-realtime-database/source_firebase_realtime_database/firebase_rtdb.py, line 7](https://github.com/airbytehq/airbyte/blob/39fa89b97929ff6646ae4d5192170e84b411a333/airbyte-integrations/connectors/source-firebase-realtime-database/source_firebase_realtime_database/firebase_rtdb.py#L7)
- **Qdrant**: 1 file · [airbyte-integrations/connectors/destination-qdrant/destination_qdrant/indexer.py, line 9](https://github.com/airbytehq/airbyte/blob/39fa89b97929ff6646ae4d5192170e84b411a333/airbyte-integrations/connectors/destination-qdrant/destination_qdrant/indexer.py#L9)

## Support

### The base

- **javax.ws.rs-api**
- **JetBrains**
- **jakarta.inject:jakarta.inject-api**: 354 files
- **io.micronaut:micronaut-inject**: 1 file

### Content

- **[beautifulsoup4](https://seerepo.com/uses/beautifulsoup4)**
- **html5lib**
- **jsoup**
- **[lxml](https://seerepo.com/uses/lxml)**
- **pyxlsb**
- **xlrd**
- **Apache**: 12 files
- **com.hubspot.jinjava:jinjava**: 1 file
- **feedparser**: 1 file
- **[jinja2](https://seerepo.com/uses/jinja2)**: 1 file
- **[openpyxl](https://seerepo.com/uses/openpyxl)**: 1 file

### Validation

- **cattrs**
- **jakarta.validation-api**
- **marshmallow**

### Testing

- **Pytest**: 886 files
- **mimesis**: 2 files

### Deploy

- **log4j-over-slf4j**
- **log4j-slf4j-impl**
- **org.apache.logging.log4j:log4j-slf4j2-impl**
- **org.slf4j:slf4j-api**: 78 files
- **[boto3](https://seerepo.com/uses/boto3)**: 5 files
- **[psutil](https://seerepo.com/uses/psutil)**: 2 files
- **org.apache.logging.log4j:log4j-api**: 1 file
- **org.apache.logging.log4j:log4j-core**: 1 file

### Tools

- **commons-cli**
- **types-pyyaml**
- **click**: 1 file
- **Setuptools**: 1 file

### Other

- **bcpkix-jdk18on**
- **bcprov-jdk18on**
- **bcutil-jdk18on**
- **com.google.guava:guava**
- **commons-codec**
- **commons-io**
- **grpc-protobuf**
- **httpcore**
- **httpcore5**
- **jackson-annotations**
- **jackson-databind-nullable**
- **jsch**
- **json-smart**
- **lz4-java**
- **okhttp**
- **org.apache.httpcomponents.core5:httpcore5-h2**
- **org.jetbrains.kotlinx:kotlinx-coroutines-core**
- **protobuf**
- **sgqlc**
- **snakeyaml**
- **snappy-java**
- **xz**
- **com.fasterxml.jackson.core:jackson-databind**: 380 files
- **requests**: 77 files
- **org.apache.commons:commons-lang3**: 41 files
- **pendulum**: 30 files
- **backoff**: 13 files
- **javax.annotation:javax.annotation-api**: 6 files
- **pandas**: 6 files
- **pytz**: 6 files
- **pyyaml**: 6 files
- **com.fasterxml.jackson.datatype:jackson-datatype-jsr310**: 4 files
- **python-dateutil**: 4 files
- **urllib3**: 4 files
- **paramiko**: 3 files
- **wcmatch**: 2 files
- **arrow**: 1 file
- **com.jayway.jsonpath:json-path**: 1 file
- **dill**: 1 file
- **httpx**: 1 file
- **info.picocli:picocli**: 1 file
- **NumPy**: 1 file
- **org.apache.commons:commons-compress**: 1 file
- **org.apache.commons:commons-text**: 1 file
- **retrying**: 1 file
- **tenacity**: 1 file

## Other repos with a similar stack

- [open-webui/open-webui](https://seerepo.com/r/open-webui/open-webui/built): pgvector, weaviate-client, Postgres, pyarrow, Redis, chromadb, pymilvus, Elasticsearch, Google Cloud Storage, Qdrant, SQLAlchemy, pyjwt, cryptography, beautifulsoup4, lxml, xlrd, openpyxl, boto3, psutil · [Compare](https://seerepo.com/compare/airbytehq/airbyte/vs/open-webui/open-webui)
- [apache/superset](https://seerepo.com/r/apache/superset/built): Postgres, MySQL, pyarrow, Redis, MongoDB, Google, Rich, SQLAlchemy, google-auth-oauthlib, pyjwt, cryptography, beautifulsoup4, pyxlsb, xlrd, jinja2, openpyxl, boto3, psutil · [Compare](https://seerepo.com/compare/airbytehq/airbyte/vs/apache/superset)
- [Significant-Gravitas/AutoGPT](https://seerepo.com/r/Significant-Gravitas/AutoGPT/built): Postgres, pyarrow, Redis, pika, Google, Rich, SQLAlchemy, google-auth-oauthlib, pyjwt, cryptography, beautifulsoup4, feedparser, jinja2, openpyxl, boto3, psutil · [Compare](https://seerepo.com/compare/airbytehq/airbyte/vs/Significant-Gravitas/AutoGPT)
- [datawhalechina/hello-agents](https://seerepo.com/r/datawhalechina/hello-agents/built): Postgres, Redis, chromadb, pymilvus, Qdrant, Rich, SQLAlchemy, onnxruntime, transformers, beautifulsoup4, lxml, xlrd, feedparser, jinja2, openpyxl · [Compare](https://seerepo.com/compare/airbytehq/airbyte/vs/datawhalechina/hello-agents)
- [langflow-ai/langflow](https://seerepo.com/r/langflow-ai/langflow/built): pyarrow, Redis, Google, Rich, SQLAlchemy, google-auth-oauthlib, pyjwt, cryptography, boto3, psutil · [Compare](https://seerepo.com/compare/airbytehq/airbyte/vs/langflow-ai/langflow)
- [debpalash/VoiceStudio](https://seerepo.com/r/debpalash/VoiceStudio/built): pyarrow, Rich, SQLAlchemy, cryptography, onnxruntime, transformers, lxml, psutil · [Compare](https://seerepo.com/compare/airbytehq/airbyte/vs/debpalash/VoiceStudio)

## Frequently asked questions

### What language is airbyte written in?

airbyte is written in Kotlin, with 770,512 written lines.

### What framework does airbyte use?

airbyte is built with javax.ws.rs-api, JetBrains, jakarta.inject:jakarta.inject-api, and io.micronaut:micronaut-inject.

### What database does airbyte use?

airbyte stores its data in Postgres, MySQL, com.zaxxer:HikariCP, pyarrow, duckdb-engine, and MongoDB and reaches it with org.jooq:jooq and SQLAlchemy.

The proof: [airbyte-integrations/connectors/destination-pgvector/destination_pgvector/pgvector_processor.py, line 26](https://github.com/airbytehq/airbyte/blob/39fa89b97929ff6646ae4d5192170e84b411a333/airbyte-integrations/connectors/destination-pgvector/destination_pgvector/pgvector_processor.py#L26)

### What does airbyte sign people in with?

airbyte signs people in with google-auth-oauthlib, google-auth, com.google.auth:google-auth-library-oauth2-http, software.amazon.awssdk:sts, pyjwt, and cryptography.

### Does airbyte use AI?

Yes. airbyte uses AI through fastembed, onnxruntime, and transformers.

### What services does airbyte use?

airbyte stores files in AWS S3, connects to Google, and uses ClickHouse, client-v2, com.mysql:mysql-connector-j, jedis, kafka-clients, org.mongodb:mongodb-driver-sync, pgvector, PostgreSQL, s3, url-connection-client, weaviate-client, zookeeper, Redis, chromadb, databend-sqlalchemy, DuckDB, pika, pymilvus, Kafka, Elasticsearch, Google Cloud Storage, Couchbase, Firebase, and Qdrant.

The proof: [airbyte-cdk/bulk/toolkits/load-fusion/src/main/kotlin/io/airbyte/cdk/fusion/S3FusionUploader.kt, line 10](https://github.com/airbytehq/airbyte/blob/39fa89b97929ff6646ae4d5192170e84b411a333/airbyte-cdk/bulk/toolkits/load-fusion/src/main/kotlin/io/airbyte/cdk/fusion/S3FusionUploader.kt#L10)

### Does airbyte have tests?

Yes. airbyte has 3,555 test files and is tested with Pytest and mimesis.

### Which repos have a stack like airbyte's?

The ones that share most of its stack: open-webui/open-webui, apache/superset, and Significant-Gravitas/AutoGPT.

## What is your repo built with?

Any public repo, with no account: https://seerepo.com/r/owner/repo/built, with the owner and name it has on GitHub.
