SeeRepo
Draw my repo

Technologies

What is crawl4ai built with?

crawl4ai is a Python repo built with FastAPI, uvicorn, AIOHTTP, and anyio. It stores its data in SQLite, signs people in with pyjwt, uses AI through rank-bm25 and mcp, makes its content with lxml, beautifulsoup4, pillow, and pypdf, validates its data with email-validator and Pydantic, is tested with playwright and fake-useragent, deploys with Gunicorn, psutil, and prometheus-fastapi-instrumentator, and uses aiosqlite and Redis. It has 176,861 written lines, with 286 test files.

Read on November 4, 2026, at commit cae74b2. Read it as markdown

Frontend

Interface

crawl4ai105 files

Backend

The base

Data

Sign-in

  • pyjwt2 files

AI

  • rank-bm255 files
  • mcp1 file

Support

The base

Content

Validation

Testing

  • playwright9 files
  • fake-useragent1 file

Deploy

  • Gunicorn
  • psutil8 files
  • prometheus-fastapi-instrumentator1 file

Tools

  • click3 files

Other

  • cssselect
  • shapely
  • httpx7 files
  • requests7 files
  • NumPy5 files
  • aiofiles4 files
  • pyyaml3 files
  • lark2 files
  • xxhash2 files
  • brotli1 file
  • chardet1 file
  • colorama1 file
  • humanize1 file
  • pyopenssl1 file
  • python-dotenv1 file
  • slowapi1 file
  • snowballstemmer1 file
  • websockets1 file

Other repos with a similar stack

Ordered by how much of its stack they share with crawl4ai, then by stars.

Frequently asked questions

What language is crawl4ai written in?
crawl4ai is written in Python, with 176,861 written lines.
What framework does crawl4ai use?
crawl4ai is built with FastAPI, uvicorn, AIOHTTP, and anyio.
What database does crawl4ai use?
crawl4ai stores its data in SQLite.

The proof: crawl4ai/async_database.py, line 4

What does crawl4ai sign people in with?
crawl4ai signs people in with pyjwt.
Does crawl4ai use AI?
Yes. crawl4ai uses AI through rank-bm25 and mcp.
What services does crawl4ai use?
crawl4ai uses aiosqlite and Redis.
Does crawl4ai have tests?
Yes. crawl4ai has 286 test files and is tested with playwright and fake-useragent.
Which repos have a stack like crawl4ai's?
The ones that share most of its stack:datawhalechina/hello-agentsopen-webui/open-webuiSignificant-Gravitas/AutoGPT

What is your repo built with?

Paste your public repo and see it drawn.

Free, no account.

Or look inside SeeRepo's own →

Is it your repo? Add its badge, keep it up to date or take it down →