Open source repos that use deepspeed

12 public repos that SeeRepo read use deepspeed. It's used most with torch, transformers, and accelerate.

Read it as markdown

Used most with

  • torch5 repos
  • accelerate4 repos
  • sentencepiece3 repos
  • datasets3 repos
deepspeed12 repos
  • transformers4 repos
  • FastAPI3 repos
  • torchvision3 repos
  • peft3 repos

The repos, by stars

  1. 1
    hiyouga/LlamaFactory

    Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

    Python+4576kAI 1.6%
  2. 2
    ray-project/ray

    Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

    Python+33244.3kAI 3.7%
  3. 3
    OpenBMB/MiniCPM-V

    See, hear, and interact on your local devices.

    Python+5527.2kAI 1.1%
  4. 4
    liguodongiot/llm-action

    本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)

    HTML+8225.3k
  5. 5
    QwenAudio/CosyVoice

    Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

    Python+2424.4k
  6. 6
    microsoft/unilm

    Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

    Python+2822.2k
  7. 7
    BlinkDL/RWKV-LM

    RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

    Python14.8k
  8. 8
    FlagOpen/FlagEmbedding

    Retrieval and Retrieval-augmented LLMs

    Python+2012.3k
  9. 9
    OpenRLHF/OpenRLHF

    An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

    Python+1510.2kAI 1.8%
  10. 10
    modelscope/modelscope

    ModelScope: bring the notion of Model-as-a-Service to life.

    Python+649.2kAI 0.1%
  11. 12
    OpenBMB/XAgent

    An Autonomous LLM Agent for Complex Task Solving

    Python+498.5kAI 1.1%

Frequently asked questions

What is the most popular open source repo that uses deepspeed?
hiyouga/LlamaFactory, with 76,016 stars on GitHub.

The proof: hiyouga/LlamaFactory on GitHub

What other technologies is deepspeed used with?
With torch (5), transformers (4), accelerate (4), FastAPI (3), and sentencepiece (3), out of the 12 repos that use it.
What languages are the repos that use deepspeed written in?
Python (11) and HTML (1).
How many repos that use deepspeed have commits signed by AI?
6 of the 12; the most, ray-project/ray, with 3.7% of its commits.

The proof: the commits each tool signed in ray-project/ray

See inside your code, today.

Paste your repo and see it drawn, part by part: a medium one in under a minute.

Free, no account.Private repo? Sign in with GitHub

Or look inside SeeRepo's own →