Source: https://seerepo.com/uses/tiktoken Markdown source: https://seerepo.com/uses/tiktoken.md Description: 13 public repos that SeeRepo read use tiktoken. It's used most with OpenAI, FastAPI, and uvicorn. # Open source repos that use tiktoken 13 public repos that SeeRepo read use tiktoken. It's used most with OpenAI, FastAPI, and uvicorn. ## Used most with - OpenAI: 4 repos - FastAPI: 4 repos - uvicorn: 3 repos - datasets: 3 repos - transformers: 3 repos - LangChain: 2 repos - Ollama: 2 repos - pillow: 2 repos ## The repos, by stars 1. [Significant-Gravitas/AutoGPT](https://seerepo.com/r/Significant-Gravitas/AutoGPT): Python · 187,891 stars · 16.8% signed by AI — AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters. 2. [open-webui/open-webui](https://seerepo.com/r/open-webui/open-webui): Svelte · 157,730 stars · 1.3% signed by AI — User-friendly AI Interface (Supports Ollama, OpenAI API, ...) 3. [langchain-ai/langchain](https://seerepo.com/r/langchain-ai/langchain): Python · 148,995 stars · 0.3% signed by AI — The agent engineering platform. 4. [vllm-project/vllm](https://seerepo.com/r/vllm-project/vllm): Python · 96,302 stars · 12.8% signed by AI — A high-throughput and memory-efficient inference and serving engine for LLMs 5. [datawhalechina/hello-agents](https://seerepo.com/r/datawhalechina/hello-agents): Python · 86,039 stars · 2.4% signed by AI — 📚 《从零开始构建智能体》——从零开始的智能体原理与实践教程 6. [unslothai/unsloth](https://seerepo.com/r/unslothai/unsloth): Python · 79,050 stars · 1% signed by AI — Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more. 7. [headroomlabs-ai/headroom](https://seerepo.com/r/headroomlabs-ai/headroom): Python · 78,851 stars · 28.1% signed by AI — Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server. 8. [rohitg00/ai-engineering-from-scratch](https://seerepo.com/r/rohitg00/ai-engineering-from-scratch): Python · 76,859 stars · 0.8% signed by AI — Learn AI Engineering! Learn it. Build it. Ship it for others. 9. [hiyouga/LlamaFactory](https://seerepo.com/r/hiyouga/LlamaFactory): Python · 75,890 stars · 1.6% signed by AI — Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024) 10. [apache/superset](https://seerepo.com/r/apache/superset): Python · 75,409 stars · 9.2% signed by AI — Apache Superset is a Data Visualization and Data Exploration Platform 11. [mlc-ai/mlc-llm](https://seerepo.com/r/mlc-ai/mlc-llm): Python · 23,302 stars · 0.2% signed by AI — Universal LLM Deployment Engine with ML Compilation 12. [comet-ml/opik](https://seerepo.com/r/comet-ml/opik): Python · 23,166 stars · 19.7% signed by AI — Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. 13. [wandb/openui](https://seerepo.com/r/wandb/openui): TypeScript · 22,733 stars — OpenUI let's you describe UI using your imagination, then see it rendered live. ## Frequently asked questions ### What is the most popular open source repo that uses tiktoken? Significant-Gravitas/AutoGPT, with 187,891 stars on GitHub. The proof: [Significant-Gravitas/AutoGPT on GitHub](https://github.com/Significant-Gravitas/AutoGPT) ### What other technologies is tiktoken used with? With OpenAI (4), FastAPI (4), uvicorn (3), datasets (3), and transformers (3), out of the 13 repos that use it. ### What languages are the repos that use tiktoken written in? Python (11), Svelte (1), and TypeScript (1). ### How many repos that use tiktoken have commits signed by AI? 12 of the 13; the most, headroomlabs-ai/headroom, with 28.1% of its commits. The proof: [the commits each tool signed in headroomlabs-ai/headroom](https://seerepo.com/r/headroomlabs-ai/headroom/ai) ## What is your repo built with? Any public repo, with no account: https://seerepo.com/r/owner/repo/built, with the owner and name it has on GitHub.