Open source repos that use triton

A high-throughput and memory-efficient inference and serving engine for LLMs

《深入理解 AI Agent：设计原理与工程实践》（李博杰 著）开源主仓库：全书正文、编译版 PDF 与按章配套代码

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Making large AI models cheaper, faster and more accessible

Open Source AI Platform - AI Chat with advanced features that works with every LLM

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

Mamba SSM architecture

FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.