Source: https://seerepo.com/uses/tiktoken-rs
Markdown source: https://seerepo.com/uses/tiktoken-rs.md
Description: 10 public repos that SeeRepo read use tiktoken-rs. It's used most with Tokio, axum, and rusqlite.

# Open source repos that use tiktoken-rs

10 public repos that SeeRepo read use tiktoken-rs. It's used most with Tokio, axum, and rusqlite.

## Used most with

- Tokio: 5 repos
- axum: 3 repos
- rusqlite: 2 repos
- SQLite: 2 repos
- tower: 2 repos
- crossterm: 2 repos
- Ratatui: 2 repos
- quick-xml: 2 repos

## The repos, by stars

1. [vllm-project/vllm](https://seerepo.com/r/vllm-project/vllm): Python · 97,060 stars · 14.7% signed by AI — A high-throughput and memory-efficient inference and serving engine for LLMs
2. [rtk-ai/rtk](https://seerepo.com/r/rtk-ai/rtk): Rust · 86,821 stars · 33.4% signed by AI — CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
3. [headroomlabs-ai/headroom](https://seerepo.com/r/headroomlabs-ai/headroom): Python · 79,868 stars · 29.7% signed by AI — Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
4. [BerriAI/litellm](https://seerepo.com/r/BerriAI/litellm): Python · 63,424 stars · 20.6% signed by AI — The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
5. [meilisearch/meilisearch](https://seerepo.com/r/meilisearch/meilisearch): Rust · 59,886 stars · 0.2% signed by AI — A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications.
6. [aaif-goose/goose](https://seerepo.com/r/aaif-goose/goose): Rust · 56,726 stars · 5% signed by AI — an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM
7. [openobserve/openobserve](https://seerepo.com/r/openobserve/openobserve): Rust · 23,138 stars · 5.1% signed by AI — Open source observability platform for logs, metrics, traces, RUM (web, android, ios), Session replay, pipelines, SLO and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage costs and single binary deployment.
8. [funstory-ai/BabelDOC](https://seerepo.com/r/funstory-ai/BabelDOC): Rust · 9,869 stars — Yet Another Document Translator
9. [deeplethe/utopia](https://seerepo.com/r/deeplethe/utopia): Rust · 8,722 stars · 57.9% signed by AI — World's first open-source enterprise world model.
10. [mufeedvh/code2prompt](https://seerepo.com/r/mufeedvh/code2prompt): Rust · 7,768 stars · 1.1% signed by AI — A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.

## Frequently asked questions

### What is the most popular open source repo that uses tiktoken-rs?

vllm-project/vllm, with 97,060 stars on GitHub.

The proof: [vllm-project/vllm on GitHub](https://github.com/vllm-project/vllm)

### What other technologies is tiktoken-rs used with?

With Tokio (5), axum (3), rusqlite (2), SQLite (2), and tower (2), out of the 10 repos that use it.

### What languages are the repos that use tiktoken-rs written in?

Rust (7) and Python (3).

### How many repos that use tiktoken-rs have commits signed by AI?

9 of the 10; the most, deeplethe/utopia, with 57.9% of its commits.

The proof: [the commits each tool signed in deeplethe/utopia](https://seerepo.com/r/deeplethe/utopia/ai)

## What is your repo built with?

Any public repo, with no account: https://seerepo.com/r/owner/repo/built, with the owner and name it has on GitHub.
