Open source repos that use gguf
10 public repos that SeeRepo read use gguf. It's used most with accelerate, torch, and Hugging Face.
Used most with
accelerate3 repos
- Hugging Face2 repos
FastAPI2 repos
Vite2 repos
- torch3 repos
- sentencepiece2 repos
React2 repos
- idb2 repos
The repos, by stars
- 1unslothai/
unsloth Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
Python+12379.7kAI 1%
- 2sgl-project/
sglang SGLang is a high-performance serving framework for large language models and multimodal models.
Python+6439kAI 9.5%
- 3tobi/
qmd mini cli search engine for your docs, knowledge bases, meeting notes, whatever. Tracking current sota approaches while being all local
TypeScript+1331.3kAI 26.5%
- 4invoke-ai/
InvokeAI Invoke is a leading creative engine that uses image and video generation models to empower professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry-leading application interface, and serves as the foundation for multiple commercial products.
TypeScript+2429.1kAI 3.4%
- 5kvcache-ai/
ktransformers A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
Python+2019.7kAI 2.2%
- 6Acly/
krita-ai-diffusion Streamlined interface for generating images with AI in Krita. Inpaint and outpaint with optional text prompt, no tweaking required.
Python+7910.9kAI 0.2%
- 7xorbitsai/
inference Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
Python
+839.7kAI 0.3% - 9magnitudedev/
magnitude Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.
Rust+527.9kAI 0.1%
- 10vllm-project/
vllm-omni A framework for efficient model inference with omni-modality models
Python+677.8kAI 11.7%
Frequently asked questions
What is the most popular open source repo that uses gguf?
The proof: unslothai/unsloth on GitHub
What other technologies is gguf used with?
What languages are the repos that use gguf written in?
How many repos that use gguf have commits signed by AI?
The proof: the commits each tool signed in tobi/qmd
See inside your code, today.
Paste your repo and see it drawn, part by part: a medium one in under a minute.
Free, no account.Private repo? Sign in with GitHub

