Source: https://seerepo.com/compare/alibaba/DataX/vs/NanmiCoder/MediaCrawler
Markdown source: https://seerepo.com/compare/alibaba/DataX/vs/NanmiCoder/MediaCrawler.md
Description: DataX and MediaCrawler share 4 technologies: MySQL, MongoDB, Postgres, and SQLite. DataX is written in Java and MediaCrawler in Python.

# DataX vs MediaCrawler

DataX and MediaCrawler share 4 technologies: MySQL, MongoDB, Postgres, and SQLite. DataX is written in Java and MediaCrawler in Python.

- [alibaba/DataX](https://seerepo.com/r/alibaba/DataX): DataX是阿里云DataWorks数据集成的开源版本。
- [NanmiCoder/MediaCrawler](https://seerepo.com/r/NanmiCoder/MediaCrawler): 小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B 站视频 ｜ 评论爬虫、微博帖子 ｜ 评论爬虫、百度贴吧帖子 ｜ 百度贴吧评论回复爬虫  | 知乎问答文章｜评论爬虫

## What they share and what sets them apart

- In common: MySQL, MongoDB, Postgres, SQLite
- Only in DataX: aliyun-sdk-oss, caffeine, hadoop-common, hadoop-mapreduce-client-core, mysql:mysql-connector-java, opengauss-jdbc, org.apache.parquet:parquet-column, parquet-avro, PostgreSQL, sqlite-jdbc, zookeeper, com.taosdata.jdbc:taos-jdbcdriver, Neo4j, org.apache.parquet:parquet-hadoop, Milvus, JetBrains, commons-logging, log4j, log4j-core, org.apache.logging.log4j:log4j-api, org.slf4j:slf4j-api, ch.qos.logback:logback-classic
- Only in MediaCrawler: FastAPI, uvicorn, aiosqlite, asyncpg, Redis, Vite, React, matplotlib, SQLAlchemy, alembic, cryptography, opencv-python, pillow, openpyxl, Pydantic, Tailwind CSS, class-variance-authority, tailwind-merge, Radix UI, sonner, Lucide

## Side by side

| | DataX | MediaCrawler |
|---|---|---|
| Size | 104,776 lines written, 830 code files | 40,863 lines written, 176 code files |
| Who writes it | 0% of its commits signed by AI | 2.7% of its commits signed by AI. With Claude Code and Codex |
| Activity | Last push July 7, 2026, 479 commits, 17,381 stars | Last push November 4, 2026, 663 commits, 70,198 stars |
| Tests | 36 test files. 5.1% of its code files have a test that imports them | 39 test files. 27.8% of its code files have a test that imports them |

- Size: Lines written by people and agents, without generated ones; code files, without tests.
- Who writes it: A commit counts as AI's when it carries its signature: a Co-Authored-By line, its author name or the merge of its branch.
- Activity: From GitHub and its history, on the day SeeRepo read it.
- Tests: The files that test the code, and the share of code files a test imports.

## Frequently asked questions

### Which is bigger, DataX or MediaCrawler?

DataX, with 104,776 lines written; MediaCrawler has 40,863.

The proof: [alibaba/DataX's code at commit 80ec23d](https://github.com/alibaba/DataX/tree/80ec23d5c5328eb90ca364d2749e92dfaf44541e)

### Which has more GitHub stars, DataX or MediaCrawler?

MediaCrawler, with 70,198 stars; DataX has 17,381.

The proof: [NanmiCoder/MediaCrawler on GitHub](https://github.com/NanmiCoder/MediaCrawler)

### Which has more tests, DataX or MediaCrawler?

MediaCrawler, with 39 test files; DataX has 36.

The proof: [NanmiCoder/MediaCrawler's code at commit b4bc7c4](https://github.com/NanmiCoder/MediaCrawler/tree/b4bc7c47582e39780783bb9f7e4fef57f93bdcae)

### Which was updated more recently, DataX or MediaCrawler?

MediaCrawler: its last push was on November 4, 2026, and DataX's on July 7, 2026.

The proof: [NanmiCoder/MediaCrawler's commits on GitHub](https://github.com/NanmiCoder/MediaCrawler/commits)

### Which has more commits signed by AI, DataX or MediaCrawler?

MediaCrawler: an AI signed 2.7% of its commits, with Claude Code and Codex.

## Sources

- alibaba/DataX: Read on November 7, 2026, at commit 80ec23d (https://github.com/alibaba/DataX/tree/80ec23d5c5328eb90ca364d2749e92dfaf44541e)
- NanmiCoder/MediaCrawler: Read on November 5, 2026, at commit b4bc7c4 (https://github.com/NanmiCoder/MediaCrawler/tree/b4bc7c47582e39780783bb9f7e4fef57f93bdcae)

## What is your repo built with?

Any public repo, with no account: https://seerepo.com/r/owner/repo/built, with the owner and name it has on GitHub.