Source: https://seerepo.com/compare/jhao104/proxy_pool/vs/unclecode/crawl4ai
Markdown source: https://seerepo.com/compare/jhao104/proxy_pool/vs/unclecode/crawl4ai.md
Description: proxy_pool and crawl4ai share 3 technologies: Redis, lxml, and Gunicorn. Both are written in Python.

# proxy_pool vs crawl4ai

proxy_pool and crawl4ai share 3 technologies: Redis, lxml, and Gunicorn. Both are written in Python.

- [jhao104/proxy_pool](https://seerepo.com/r/jhao104/proxy_pool): Python ProxyPool for web spider
- [unclecode/crawl4ai](https://seerepo.com/r/unclecode/crawl4ai): Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.

## What they share and what sets them apart

- In common: Redis, lxml, Gunicorn
- Only in proxy_pool: Flask, werkzeug
- Only in crawl4ai: FastAPI, uvicorn, aiosqlite, SQLite, AIOHTTP, anyio, Rich, pyjwt, rank-bm25, MCP, beautifulsoup4, pillow, pypdf, email-validator, Pydantic, psutil, prometheus-fastapi-instrumentator

## Side by side

| | proxy_pool | crawl4ai |
|---|---|---|
| Size | 5,508 lines written, 40 code files | 176,861 lines written, 105 code files |
| Who writes it | 0% of its commits signed by AI | 4.4% of its commits signed by AI. With Claude Code, Factory, Cursor, CodeRabbit, and Devin |
| Activity | Last push June 15, 2026, 533 commits, 23,781 stars | Last push November 4, 2026, 1,446 commits, 86,895 stars |
| Tests | 22 test files. 82.5% of its code files have a test that imports them | 286 test files. 56.2% of its code files have a test that imports them |

- Size: Lines written by people and agents, without generated ones; code files, without tests.
- Who writes it: A commit counts as AI's when it carries its signature: a Co-Authored-By line, its author name or the merge of its branch.
- Activity: From GitHub and its history, on the day SeeRepo read it.
- Tests: The files that test the code, and the share of code files a test imports.

## Frequently asked questions

### Which is bigger, proxy_pool or crawl4ai?

crawl4ai, with 176,861 lines written; proxy_pool has 5,508.

The proof: [unclecode/crawl4ai's code at commit cae74b2](https://github.com/unclecode/crawl4ai/tree/cae74b203a33994f7e13b9052c3b0d5c93daa0e6)

### Which has more GitHub stars, proxy_pool or crawl4ai?

crawl4ai, with 86,895 stars; proxy_pool has 23,781.

The proof: [unclecode/crawl4ai on GitHub](https://github.com/unclecode/crawl4ai)

### Which has more tests, proxy_pool or crawl4ai?

crawl4ai, with 286 test files; proxy_pool has 22.

The proof: [unclecode/crawl4ai's code at commit cae74b2](https://github.com/unclecode/crawl4ai/tree/cae74b203a33994f7e13b9052c3b0d5c93daa0e6)

### Which was updated more recently, proxy_pool or crawl4ai?

crawl4ai: its last push was on November 4, 2026, and proxy_pool's on June 15, 2026.

The proof: [unclecode/crawl4ai's commits on GitHub](https://github.com/unclecode/crawl4ai/commits)

### Which has more commits signed by AI, proxy_pool or crawl4ai?

crawl4ai: an AI signed 4.4% of its commits, with Claude Code, Factory, Cursor, CodeRabbit, and Devin.

The proof: [the commits each tool signed in unclecode/crawl4ai](https://seerepo.com/r/unclecode/crawl4ai/ai)

## Sources

- jhao104/proxy_pool: Read on November 4, 2026, at commit 9cc0cad (https://github.com/jhao104/proxy_pool/tree/9cc0cad4c47e84e34aaec2eead099421960dcd07)
- unclecode/crawl4ai: Read on November 4, 2026, at commit cae74b2 (https://github.com/unclecode/crawl4ai/tree/cae74b203a33994f7e13b9052c3b0d5c93daa0e6)

## What is your repo built with?

Any public repo, with no account: https://seerepo.com/r/owner/repo/built, with the owner and name it has on GitHub.