Source: https://seerepo.com/r/apache/beam/built
Markdown source: https://seerepo.com/r/apache/beam/built.md
Description: beam is a Java repo built with Flask, flutter_web_plugins, JetBrains, Apache, javax.servlet:javax.servlet-api, and 5 more.

# What is beam built with?

beam is a Java repo built with Flask, flutter_web_plugins, JetBrains, Apache, javax.servlet:javax.servlet-api, and 5 more. It stores its data in MongoDB, SQLite, and MySQL, signs people in with firebase_auth, firebase_auth_platform_interface, com.azure:azure-identity, cryptography, and golang.org/x/oauth2, uses AI through openai-java-core, tf-keras, TensorFlow, tensorflow-transform, and OpenAI, connects to Google, makes its content with flutter_svg, org.apache.tika:tika-core, pillow, and markdown, validates its data with Pydantic and beartype, is tested with mockserver-client-java, pytest-asyncio, junit:junit, Pytest, github.com/google/go-cmp, and 15 more, runs in production with log4j-slf4j-impl, slf4j-jdk14, org.slf4j:slf4j-api, cloud.google.com/go/logging, github.com/aws/aws-sdk-go-v2, and 3 more, and uses avatica-core, calcite-druid, ClickHouse, client-v2, go.mongodb.org/mongo-driver, and 51 more. It has 2,314,803 written lines, with 3,825 test files.

Read on November 16, 2026, at commit 8ab5661.

Repository: https://github.com/apache/beam

## Frontend (/)

### Styles

- **google_fonts**: 2 files

### Interface

- **flutter_code_editor**: 8 files
- **highlight**: 4 files
- **fluttertoast**: 1 file
- **visibility_detector**: 1 file

## Backend (/)

### The base

- **[Flask](https://seerepo.com/uses/flask)**

### Data

- **avatica-core**
- **calcite-druid**
- **[ClickHouse](https://seerepo.com/uses/clickhouse)**
- **client-v2**
- **[go.mongodb.org/mongo-driver](https://seerepo.com/uses/gomongodborg-mongo-driver)**
- **[hadoop-common](https://seerepo.com/uses/hadoop-common)**
- **hbase-client**
- **[Hive](https://seerepo.com/uses/hive)**
- **iceberg-api**
- **iceberg-aws**
- **iceberg-core**
- **iceberg-data**
- **iceberg-gcp**
- **iceberg-hive-metastore**
- **iceberg-orc**
- **iceberg-parquet**
- **[jedis](https://seerepo.com/uses/jedis)**
- **kafka-avro-serializer**
- **[kafka-clients](https://seerepo.com/uses/kafka-clients)**
- **[mssql-jdbc](https://seerepo.com/uses/mssql-jdbc)**
- **[ojdbc8](https://seerepo.com/uses/ojdbc8)**
- **orc-core**
- **[pq](https://seerepo.com/uses/pq)**
- **pulsar-client-api**
- **[pymongo](https://seerepo.com/uses/pymongo)**
- **[s3](https://seerepo.com/uses/s3)**
- **[sqlite-jdbc](https://seerepo.com/uses/sqlite-jdbc)**
- **util-hadoop**
- **[org.apache.avro:avro](https://seerepo.com/uses/orgapacheavro-avro)**: 57 files
- **software.amazon.kinesis:amazon-kinesis-client**: 13 files
- **[MongoDB](https://seerepo.com/uses/mongodb)**: 10 files · [sdks/python/apache_beam/io/mongodbio.py, line 96](https://github.com/apache/beam/blob/8ab5661c1e6cb5c35d4906c110d288f9798df1af/sdks/python/apache_beam/io/mongodbio.py#L96)
- **[org.apache.parquet:parquet-hadoop](https://seerepo.com/uses/orgapacheparquet-parquet-hadoop)**: 10 files
- **DataStax**: 8 files
- **[pyarrow](https://seerepo.com/uses/pyarrow)**: 7 files
- **fastavro**: 6 files
- **jakarta.jms:jakarta.jms-api**: 6 files
- **[org.apache.commons:commons-pool2](https://seerepo.com/uses/orgapachecommons-commons-pool2)**: 6 files
- **[com.azure:azure-storage-blob](https://seerepo.com/uses/comazure-azure-storage-blob)**: 5 files
- **[NATS.io](https://seerepo.com/uses/natsio)**: 4 files
- **org.apache.kudu:kudu-client**: 4 files
- **com.azure:azure-cosmos**: 3 files
- **org.apache.qpid:proton-j**: 3 files
- **org.apache.solr:solr-solrj**: 3 files
- **[SQLite](https://seerepo.com/uses/sqlite)**: 3 files · [sdks/java/core/src/main/java/org/apache/beam/sdk/util/SerializableUtils.java, line 37](https://github.com/apache/beam/blob/8ab5661c1e6cb5c35d4906c110d288f9798df1af/sdks/java/core/src/main/java/org/apache/beam/sdk/util/SerializableUtils.java#L37)
- **[MySQL](https://seerepo.com/uses/mysql)**: 2 files · [sdks/go.mod, line 43](https://github.com/apache/beam/blob/8ab5661c1e6cb5c35d4906c110d288f9798df1af/sdks/go.mod#L43)
- **[Neo4j](https://seerepo.com/uses/neo4j)**: 2 files
- **[RabbitMQ](https://seerepo.com/uses/rabbitmq)**: 2 files
- **[shared_preferences](https://seerepo.com/uses/shared-preferences)**: 2 files
- **com.microsoft.azure:azure-storage**: 1 file
- **[Elasticsearch](https://seerepo.com/uses/elasticsearch)**: 1 file
- **[github.com/aws/aws-sdk-go-v2/feature/s3/manager](https://seerepo.com/uses/githubcom-aws-aws-sdk-go-v2-feature-s3-manager)**: 1 file
- **github.com/xitongsys/parquet-go**: 1 file
- **github.com/xitongsys/parquet-go-source**: 1 file
- **io.confluent:kafka-schema-registry-client**: 1 file
- **org.apache.parquet:parquet-avro**: 1 file
- **[Postgres](https://seerepo.com/uses/postgres)**: 1 file · [sdks/go.mod, line 47](https://github.com/apache/beam/blob/8ab5661c1e6cb5c35d4906c110d288f9798df1af/sdks/go.mod#L47)

### Sign-in

- **firebase_auth**
- **firebase_auth_platform_interface**
- **[com.azure:azure-identity](https://seerepo.com/uses/comazure-azure-identity)**: 2 files
- **[cryptography](https://seerepo.com/uses/cryptography)**: 2 files
- **[golang.org/x/oauth2](https://seerepo.com/uses/golangorg-x-oauth2)**: 2 files

### AI

- **openai-java-core**
- **tf-keras**
- **[TensorFlow](https://seerepo.com/uses/tensorflow)**: 5 files
- **tensorflow-transform**: 3 files

### Services

- **[Google](https://seerepo.com/uses/google)**: 158 files · [sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryServices.java, line 33](https://github.com/apache/beam/blob/8ab5661c1e6cb5c35d4906c110d288f9798df1af/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryServices.java#L33)
- **[Kafka](https://seerepo.com/uses/kafka)**: 61 files · [sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/KafkaRecord.java, line 23](https://github.com/apache/beam/blob/8ab5661c1e6cb5c35d4906c110d288f9798df1af/sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/KafkaRecord.java#L23)
- **[Google Cloud Storage](https://seerepo.com/uses/google-cloud-storage)**: 10 files · [sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/extensions/gcp/util/GcsUtil.java, line 25](https://github.com/apache/beam/blob/8ab5661c1e6cb5c35d4906c110d288f9798df1af/sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/extensions/gcp/util/GcsUtil.java#L25)
- **[Firebase](https://seerepo.com/uses/firebase)**: 8 files · [learning/tour-of-beam/frontend/lib/firebase_options.dart, line 3](https://github.com/apache/beam/blob/8ab5661c1e6cb5c35d4906c110d288f9798df1af/learning/tour-of-beam/frontend/lib/firebase_options.dart#L3)
- **[OpenAI](https://seerepo.com/uses/openai)**: 1 file · [sdks/java/ml/inference/openai/src/main/java/org/apache/beam/sdk/ml/inference/openai/OpenAIModelHandler.java, line 24](https://github.com/apache/beam/blob/8ab5661c1e6cb5c35d4906c110d288f9798df1af/sdks/java/ml/inference/openai/src/main/java/org/apache/beam/sdk/ml/inference/openai/OpenAIModelHandler.java#L24)

## Support (/)

### The base

- **flutter_web_plugins**
- **[JetBrains](https://seerepo.com/uses/jetbrains)**
- **[Apache](https://seerepo.com/uses/apache)**: 423 files
- **[javax.servlet:javax.servlet-api](https://seerepo.com/uses/javaxservlet-javaxservlet-api)**: 11 files
- **[org.eclipse.jetty:jetty-server](https://seerepo.com/uses/orgeclipsejetty-jetty-server)**: 1 file
- **org.eclipse.jetty:jetty-servlet**: 1 file

### Content

- **[flutter_svg](https://seerepo.com/uses/flutter-svg)**: 17 files
- **[org.apache.tika:tika-core](https://seerepo.com/uses/orgapachetika-tika-core)**: 2 files
- **[pillow](https://seerepo.com/uses/pillow)**: 2 files
- **[markdown](https://seerepo.com/uses/markdown)**: 1 file

### Validation

- **[Pydantic](https://seerepo.com/uses/pydantic)**: 3 files
- **[beartype](https://seerepo.com/uses/beartype)**: 1 file

### Testing

- **mockserver-client-java**
- **pytest-asyncio**
- **junit:junit**: 2,214 files
- **Pytest**: 134 files
- **github.com/google/go-cmp**: 82 files
- **mock**: 72 files
- **org.testcontainers:testcontainers**: 64 files
- **flutter_test**: 55 files
- **github.com/stretchr/testify**: 7 files
- **org.awaitility:awaitility**: 6 files
- **[com.zaxxer:HikariCP](https://seerepo.com/uses/comzaxxer-hikaricp)**: 3 files
- **github.com/testcontainers/testcontainers-go**: 3 files
- **go.uber.org/goleak**: 3 files
- **org.apache.pulsar:pulsar-client**: 2 files
- **clock**: 1 file
- **[github.com/aws/aws-sdk-go-v2/credentials](https://seerepo.com/uses/githubcom-aws-aws-sdk-go-v2-credentials)**: 1 file
- **github.com/fsouza/fake-gcs-server**: 1 file
- **github.com/johannesboyne/gofakes3**: 1 file
- **pytest-mock**: 1 file

### Deploy

- **[log4j-slf4j-impl](https://seerepo.com/uses/log4j-slf4j-impl)**
- **slf4j-jdk14**
- **[org.slf4j:slf4j-api](https://seerepo.com/uses/orgslf4j-slf4j-api)**: 622 files
- **cloud.google.com/go/logging**: 2 files
- **[github.com/aws/aws-sdk-go-v2](https://seerepo.com/uses/githubcom-aws-aws-sdk-go-v2)**: 2 files
- **[github.com/aws/aws-sdk-go-v2/config](https://seerepo.com/uses/githubcom-aws-aws-sdk-go-v2-config)**: 1 file
- **[github.com/moby/moby/api](https://seerepo.com/uses/githubcom-moby-moby-api)**: 1 file
- **[github.com/moby/moby/client](https://seerepo.com/uses/githubcom-moby-moby-client)**: 1 file

### Tools

- **commons-cli**
- **gradle-docker-compose-plugin**
- **gradle-errorprone-plugin**
- **grgit-gradle**
- **grpcio-tools**
- **maven-invoker**
- **Shadow**
- **spotless-plugin-gradle**
- **com.google.auto.value:auto-value-annotations**: 663 files
- **com.google.protobuf:protobuf-gradle-plugin**: 93 files
- **json_annotation**: 16 files
- **typing-extensions**: 6 files
- **packaging**: 4 files
- **github.com/spf13/cobra**: 3 files
- **github.com/aws/smithy-go**: 1 file
- **org.codehaus.janino:commons-compiler**: 1 file

### Other

- **,**
- **calcite-core**
- **commons-lang**
- **hadoop-yarn-server-resourcemanager**
- **httpasyncclient**
- **httpcore**
- **httpcore-nio**
- **json-smart**
- **okhttp**
- **proto-plus**
- **protobuf**
- **pyyaml**
- **reactor-core**
- **Scala**
- **t**
- **wazero**
- **joda-time:joda-time**: 720 files
- **com.fasterxml.jackson.core:jackson-databind**: 87 files
- **com.fasterxml.jackson.core:jackson-core**: 52 files
- **easy_localization**: 49 files
- **google.golang.org/protobuf**: 49 files
- **com.google.guava:guava**: 41 files
- **get_it**: 36 files
- **NumPy**: 29 files
- **grpcio**: 24 files
- **org.apache.commons:commons-lang3**: 24 files
- **provider**: 20 files
- **com.google.http-client:google-http-client-gson**: 18 files
- **equatable**: 15 files
- **golang.org/x/exp**: 11 files
- **Esoteric Software**: 10 files
- **url_launcher**: 10 files
- **collection**: 8 files
- **requests**: 8 files
- **org.apache.httpcomponents:httpclient**: 7 files
- **pytz**: 7 files
- **com.azure:azure-core**: 5 files
- **dill**: 5 files
- **org.apache.thrift:libthrift**: 4 files
- **golang.org/x/net**: 3 files
- **golang.org/x/sync**: 3 files
- **gopkg.in/yaml.v3**: 3 files
- **grpc**: 3 files
- **meta**: 3 files
- **python-dateutil**: 3 files
- **sortedcontainers**: 3 files
- **com.clearspring.analytics:stream**: 2 files
- **connectivity_plus**: 2 files
- **github.com/dustin/go-humanize**: 2 files
- **github.com/linkedin/goavro/v2**: 2 files
- **golang.org/x/text**: 2 files
- **google-crc32c**: 2 files
- **intl**: 2 files
- **tqdm**: 2 files
- **Avast**: 1 file
- **com.tdunning:t-digest**: 1 file
- **fasteners**: 1 file
- **[Flutter](https://seerepo.com/uses/flutter)**: 1 file
- **github.com/improbable-eng/grpc-web**: 1 file
- **github.com/rs/cors**: 1 file
- **github.com/spf13/viper**: 1 file
- **golang.org/x/sys**: 1 file
- **gopkg.in/yaml.v2**: 1 file
- **http**: 1 file
- **httplib2**: 1 file
- **jline:jline**: 1 file
- **jsonpickle**: 1 file
- **org.bouncycastle:bcprov-jdk15on**: 1 file
- **org.codehaus.janino:janino**: 1 file
- **org.conscrypt:conscrypt-openjdk-uber**: 1 file
- **org.objenesis:objenesis**: 1 file
- **org.reactivestreams:reactive-streams**: 1 file
- **rxdart**: 1 file
- **[yaml](https://seerepo.com/uses/yaml)**: 1 file
- **zstandard**: 1 file

## Frontend (sdks/python/apache_beam/runners/interactive/extensions/apache-beam-jupyterlab-sidepanel)

### The base

- **Jupyter**
- **[React](https://seerepo.com/uses/react)**: 16 files

### Interface

- **[xyflow](https://seerepo.com/uses/xyflow)**: 4 files
- **@lumino/widgets**: 2 files
- **@jupyterlab/mainmenu**: 1 file
- **[@monaco-editor/react](https://seerepo.com/uses/monaco-editor-react)**: 1 file
- **[dagre](https://seerepo.com/uses/dagre)**: 1 file
- **react-split**: 1 file

## Support (sdks/python/apache_beam/runners/interactive/extensions/apache-beam-jupyterlab-sidepanel)

### The base

- **@jupyterlab/application**: 1 file
- **[Apache](https://seerepo.com/uses/apache)**: 1 file

### Testing

- **Testing Library**: 6 files

### Tools

- **jupyterlab**

### Other

- **Lodash**: 2 files

## Other repos with a similar stack

- [infiniflow/ragflow](https://seerepo.com/r/infiniflow/ragflow/built): pq, s3, NATS.io, MySQL, Postgres, Google, OpenAI, React, golang.org/x/oauth2, beartype, github.com/aws/aws-sdk-go-v2, github.com/aws/aws-sdk-go-v2/config, xyflow, @monaco-editor/react · [Compare](https://seerepo.com/compare/apache/beam/vs/infiniflow/ragflow)
- [apache/superset](https://seerepo.com/r/apache/superset/built): Flask, pymongo, MongoDB, pyarrow, MySQL, Postgres, Google, React, cryptography, pillow, markdown, Pydantic, beartype · [Compare](https://seerepo.com/compare/apache/beam/vs/apache/superset)
- [apache/airflow](https://seerepo.com/r/apache/airflow/built): Flask, pymongo, pyarrow, fastavro, SQLite, Neo4j, Google, Apache, React, cryptography, Pydantic, org.slf4j:slf4j-api · [Compare](https://seerepo.com/compare/apache/airflow/vs/apache/beam)
- [open-webui/open-webui](https://seerepo.com/r/open-webui/open-webui/built): pyarrow, SQLite, Elasticsearch, Postgres, Google Cloud Storage, OpenAI, cryptography, pillow, markdown, Pydantic, xyflow · [Compare](https://seerepo.com/compare/apache/beam/vs/open-webui/open-webui)
- [usememos/memos](https://seerepo.com/r/usememos/memos/built): pq, s3, SQLite, MySQL, Postgres, Google, OpenAI, React, golang.org/x/oauth2, github.com/aws/aws-sdk-go-v2, github.com/aws/aws-sdk-go-v2/config · [Compare](https://seerepo.com/compare/apache/beam/vs/usememos/memos)
- [mudler/LocalAI](https://seerepo.com/r/mudler/LocalAI/built): s3, pyarrow, NATS.io, SQLite, Postgres, OpenAI, React, golang.org/x/oauth2, pillow, github.com/aws/aws-sdk-go-v2, github.com/aws/aws-sdk-go-v2/config · [Compare](https://seerepo.com/compare/apache/beam/vs/mudler/LocalAI)

## Frequently asked questions

### What language is beam written in?

beam is written in Java, with 2,314,803 written lines.

### What framework does beam use?

beam is built with Flask, flutter_web_plugins, JetBrains, Apache, javax.servlet:javax.servlet-api, org.eclipse.jetty:jetty-server, org.eclipse.jetty:jetty-servlet, Jupyter, React, and @jupyterlab/application.

### What database does beam use?

beam stores its data in MongoDB, SQLite, and MySQL.

The proof: [sdks/python/apache_beam/io/mongodbio.py, line 96](https://github.com/apache/beam/blob/8ab5661c1e6cb5c35d4906c110d288f9798df1af/sdks/python/apache_beam/io/mongodbio.py#L96)

### What does beam sign people in with?

beam signs people in with firebase_auth, firebase_auth_platform_interface, com.azure:azure-identity, cryptography, and golang.org/x/oauth2.

### Does beam use AI?

Yes. beam uses AI through openai-java-core, tf-keras, TensorFlow, tensorflow-transform, and OpenAI.

### What services does beam use?

beam connects to Google and uses avatica-core, calcite-druid, ClickHouse, client-v2, go.mongodb.org/mongo-driver, hadoop-common, hbase-client, Hive, iceberg-api, iceberg-aws, iceberg-core, iceberg-data, iceberg-gcp, iceberg-hive-metastore, iceberg-orc, iceberg-parquet, jedis, kafka-avro-serializer, kafka-clients, mssql-jdbc, ojdbc8, orc-core, pq, pulsar-client-api, pymongo, s3, sqlite-jdbc, util-hadoop, org.apache.avro:avro, software.amazon.kinesis:amazon-kinesis-client, org.apache.parquet:parquet-hadoop, DataStax, pyarrow, fastavro, jakarta.jms:jakarta.jms-api, org.apache.commons:commons-pool2, com.azure:azure-storage-blob, NATS.io, org.apache.kudu:kudu-client, com.azure:azure-cosmos, org.apache.qpid:proton-j, org.apache.solr:solr-solrj, Neo4j, RabbitMQ, shared_preferences, com.microsoft.azure:azure-storage, Elasticsearch, github.com/aws/aws-sdk-go-v2/feature/s3/manager, github.com/xitongsys/parquet-go, github.com/xitongsys/parquet-go-source, io.confluent:kafka-schema-registry-client, org.apache.parquet:parquet-avro, Postgres, Kafka, Google Cloud Storage, and Firebase.

The proof: [sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryServices.java, line 33](https://github.com/apache/beam/blob/8ab5661c1e6cb5c35d4906c110d288f9798df1af/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryServices.java#L33)

### Does beam have tests?

Yes. beam has 3,825 test files and is tested with mockserver-client-java, pytest-asyncio, junit:junit, Pytest, github.com/google/go-cmp, mock, org.testcontainers:testcontainers, flutter_test, github.com/stretchr/testify, org.awaitility:awaitility, com.zaxxer:HikariCP, github.com/testcontainers/testcontainers-go, go.uber.org/goleak, org.apache.pulsar:pulsar-client, clock, github.com/aws/aws-sdk-go-v2/credentials, github.com/fsouza/fake-gcs-server, github.com/johannesboyne/gofakes3, pytest-mock, and Testing Library.

### Which repos have a stack like beam's?

The ones that share most of its stack: infiniflow/ragflow, apache/superset, and apache/airflow.

## What is your repo built with?

Any public repo, with no account: https://seerepo.com/r/owner/repo/built, with the owner and name it has on GitHub.
