Repos open source que usan Ray

A high-throughput and memory-efficient inference and serving engine for LLMs

LlamaIndex is the document processing platform for AI

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Making large AI models cheaper, faster and more accessible

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

Hydra is a framework for elegantly configuring complex applications

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)