Open source repos that use flash-attn

12 public repos that SeeRepo read use flash-attn. It's used most with torch, transformers, and einops.

Read it as markdown

Used most with

  • torch6 repos
  • einops5 repos
  • accelerate4 repos
  • Rich3 repos
flash-attn12 repos
  • transformers5 repos
  • matplotlib4 repos
  • peft4 repos
  • torchvision3 repos

The repos, by stars

  1. 1
    RVC-Boss/GPT-SoVITS

    1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

    Python+3164.9kAI 0.2%
  2. 2
    mudler/LocalAI

    LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

    Go+14550.3kAI 6%
  3. 3
    hpcaitech/ColossalAI

    Making large AI models cheaper, faster and more accessible

    Python+4641.4kAI 0.3%
  4. 4
    OpenBMB/MiniCPM-V

    See, hear, and interact on your local devices.

    Python+5527.2kAI 1.1%
  5. 5
    Wan-Video/Wan2.2

    Wan: Open and Advanced Large-Scale Video Generative Models

    Python+2318.4k
  6. 6
    NVIDIA/TensorRT-LLM

    TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

    Python+5815kAI 1.7%
  7. 7
    ace-step/ACE-Step-1.5

    The most powerful local music generation model that outperforms almost all commercial alternatives, supporting Mac, AMD, Intel, and CUDA devices.

    Python+2314.5kAI 35.8%
  8. 8
    FlagOpen/FlagEmbedding

    Retrieval and Retrieval-augmented LLMs

    Python+2012.3k
  9. 9
    OpenRLHF/OpenRLHF

    An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

    Python+1510.2kAI 1.8%
  10. 11
    X-PLUG/MobileAgent

    Mobile-Agent: The Powerful GUI Agent Family

    HTML+729.4k
  11. 12
    tile-ai/tilelang

    Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels

    Python+109kAI 4.5%

Frequently asked questions

What is the most popular open source repo that uses flash-attn?
RVC-Boss/GPT-SoVITS, with 64,891 stars on GitHub.

The proof: RVC-Boss/GPT-SoVITS on GitHub

What other technologies is flash-attn used with?
With torch (6), transformers (5), einops (5), matplotlib (4), and accelerate (4), out of the 12 repos that use it.
What languages are the repos that use flash-attn written in?
Python (10), Go (1), and HTML (1).
How many repos that use flash-attn have commits signed by AI?
8 of the 12; the most, ace-step/ACE-Step-1.5, with 35.8% of its commits.

The proof: the commits each tool signed in ace-step/ACE-Step-1.5

See inside your code, today.

Paste your repo and see it drawn, part by part: a medium one in under a minute.

Free, no account.

Or look inside SeeRepo's own →