Source: https://seerepo.com/uses/gguf
Markdown source: https://seerepo.com/uses/gguf.md
Description: 10 public repos that SeeRepo read use gguf. It's used most with accelerate, torch, and Hugging Face.

# Open source repos that use gguf

10 public repos that SeeRepo read use gguf. It's used most with accelerate, torch, and Hugging Face.

## Used most with

- accelerate: 3 repos
- torch: 3 repos
- Hugging Face: 2 repos
- sentencepiece: 2 repos
- FastAPI: 2 repos
- React: 2 repos
- Vite: 2 repos
- idb: 2 repos

## The repos, by stars

1. [unslothai/unsloth](https://seerepo.com/r/unslothai/unsloth): Python · 79,651 stars · 1% signed by AI — Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
2. [sgl-project/sglang](https://seerepo.com/r/sgl-project/sglang): Python · 39,041 stars · 9.5% signed by AI — SGLang is a high-performance serving framework for large language models and multimodal models.
3. [tobi/qmd](https://seerepo.com/r/tobi/qmd): TypeScript · 31,260 stars · 26.5% signed by AI — mini cli search engine for your docs, knowledge bases, meeting notes, whatever. Tracking current sota approaches while being all local
4. [invoke-ai/InvokeAI](https://seerepo.com/r/invoke-ai/InvokeAI): TypeScript · 29,129 stars · 3.4% signed by AI — Invoke is a leading creative engine that uses image and video generation models to empower professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry-leading application interface, and serves as the foundation for multiple commercial products.
5. [kvcache-ai/ktransformers](https://seerepo.com/r/kvcache-ai/ktransformers): Python · 19,660 stars · 2.2% signed by AI — A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
6. [Acly/krita-ai-diffusion](https://seerepo.com/r/Acly/krita-ai-diffusion): Python · 10,887 stars · 0.2% signed by AI — Streamlined interface for generating images with AI in Krita. Inpaint and outpaint with optional text prompt, no tweaking required.
7. [xorbitsai/inference](https://seerepo.com/r/xorbitsai/inference): Python · 9,655 stars · 0.3% signed by AI — Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
8. [thewh1teagle/vibe](https://seerepo.com/r/thewh1teagle/vibe): Rust · 8,144 stars · 9.1% signed by AI — Transcribe on your own!
9. [magnitudedev/magnitude](https://seerepo.com/r/magnitudedev/magnitude): Rust · 7,893 stars · 0.1% signed by AI — Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.
10. [vllm-project/vllm-omni](https://seerepo.com/r/vllm-project/vllm-omni): Python · 7,828 stars · 11.7% signed by AI — A framework for efficient model inference with omni-modality models

## Frequently asked questions

### What is the most popular open source repo that uses gguf?

unslothai/unsloth, with 79,651 stars on GitHub.

The proof: [unslothai/unsloth on GitHub](https://github.com/unslothai/unsloth)

### What other technologies is gguf used with?

With accelerate (3), torch (3), Hugging Face (2), sentencepiece (2), and FastAPI (2), out of the 10 repos that use it.

### What languages are the repos that use gguf written in?

Python (6), Rust (2), and TypeScript (2).

### How many repos that use gguf have commits signed by AI?

10 of the 10; the most, tobi/qmd, with 26.5% of its commits.

The proof: [the commits each tool signed in tobi/qmd](https://seerepo.com/r/tobi/qmd/ai)

## What is your repo built with?

Any public repo, with no account: https://seerepo.com/r/owner/repo/built, with the owner and name it has on GitHub.
