Open source repos that use gguf

10 public repos that SeeRepo read use gguf. It's used most with accelerate, torch, and Hugging Face.

Read it as markdown

Used most with

  • accelerate3 repos
  • Hugging Face2 repos
  • FastAPI2 repos
  • Vite2 repos
gguf10 repos
  • torch3 repos
  • sentencepiece2 repos
  • React2 repos
  • idb2 repos

The repos, by stars

  1. 1
    unslothai/unsloth

    Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

    Python+12379.7kAI 1%
  2. 2
    sgl-project/sglang

    SGLang is a high-performance serving framework for large language models and multimodal models.

    Python+6439kAI 9.5%
  3. 3
    tobi/qmd

    mini cli search engine for your docs, knowledge bases, meeting notes, whatever. Tracking current sota approaches while being all local

    TypeScript+1331.3kAI 26.5%
  4. 4
    invoke-ai/InvokeAI

    Invoke is a leading creative engine that uses image and video generation models to empower professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry-leading application interface, and serves as the foundation for multiple commercial products.

    TypeScript+2429.1kAI 3.4%
  5. 5
    kvcache-ai/ktransformers

    A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

    Python+2019.7kAI 2.2%
  6. 6
    Acly/krita-ai-diffusion

    Streamlined interface for generating images with AI in Krita. Inpaint and outpaint with optional text prompt, no tweaking required.

    Python+7910.9kAI 0.2%
  7. 7
    xorbitsai/inference

    Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.

    Python+839.7kAI 0.3%
  8. 8
    thewh1teagle/vibe

    Transcribe on your own!

    Rust+408.1kAI 9.1%
  9. 9
    magnitudedev/magnitude

    Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.

    Rust+527.9kAI 0.1%
  10. 10
    vllm-project/vllm-omni

    A framework for efficient model inference with omni-modality models

    Python+677.8kAI 11.7%

Frequently asked questions

What is the most popular open source repo that uses gguf?
unslothai/unsloth, with 79,651 stars on GitHub.

The proof: unslothai/unsloth on GitHub

What other technologies is gguf used with?
With accelerate (3), torch (3), Hugging Face (2), sentencepiece (2), and FastAPI (2), out of the 10 repos that use it.
What languages are the repos that use gguf written in?
Python (6), Rust (2), and TypeScript (2).
How many repos that use gguf have commits signed by AI?
10 of the 10; the most, tobi/qmd, with 26.5% of its commits.

The proof: the commits each tool signed in tobi/qmd

See inside your code, today.

Paste your repo and see it drawn, part by part: a medium one in under a minute.

Free, no account.Private repo? Sign in with GitHub

Or look inside SeeRepo's own →