Source: https://seerepo.com/compare/hiyouga/LlamaFactory/vs/lucidrains/PaLM-rlhf-pytorch
Markdown source: https://seerepo.com/compare/hiyouga/LlamaFactory/vs/lucidrains/PaLM-rlhf-pytorch.md
Description: LlamaFactory and PaLM-rlhf-pytorch share 3 technologies: einops, torch, and accelerate. Both are written in Python.

# LlamaFactory vs PaLM-rlhf-pytorch

LlamaFactory and PaLM-rlhf-pytorch share 3 technologies: einops, torch, and accelerate. Both are written in Python.

- [hiyouga/LlamaFactory](https://seerepo.com/r/hiyouga/LlamaFactory): Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
- [lucidrains/PaLM-rlhf-pytorch](https://seerepo.com/r/lucidrains/PaLM-rlhf-pytorch): Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

## What they share and what sets them apart

- In common: einops, torch, accelerate
- Only in LlamaFactory: FastAPI, uvicorn, Gradio, matplotlib, aqlm, eetq, gptqmodel, hqq, ktransformers, sentencepiece, tiktoken, torchvision, triton-ascend, vector-quantize-pytorch, vocos, transformers, datasets, trl, peft, badam, deepspeed, safetensors, torch-npu, vLLM, fsdp-turbo, liger-kernel, ModelScope, openmind, torchaudio, adam-mini, apollo-torch, bitsandbytes, galore-torch, nltk, optimum, rouge-chinese, sglang, torchao, torchdata, transformer-engine, torchcodec, av, jsonschema-specifications, referencing, Pydantic, swanlab
- Only in PaLM-rlhf-pytorch: einx, beartype

## Side by side

| | LlamaFactory | PaLM-rlhf-pytorch |
|---|---|---|
| Size | 62,918 lines written, 194 code files | 3,612 lines written, 13 code files |
| Who writes it | 1.7% of its commits signed by AI. With Gemini CLI, Claude Code, GitHub Copilot, and Cursor | 0% of its commits signed by AI |
| Activity | Last push November 17, 2026, 2,783 commits, 76,077 stars | Last push September 20, 2026, 157 commits, 7,863 stars |
| Tests | 63 test files. 38.1% of its code files have a test that imports them | 0 test files |

- Size: Lines written by people and agents, without generated ones; code files, without tests.
- Who writes it: A commit counts as AI's when it carries its signature: a Co-Authored-By line, its author name or the merge of its branch.
- Activity: From GitHub and its history, on the day SeeRepo read it.
- Tests: The files that test the code, and the share of code files a test imports.

## Frequently asked questions

### Which is bigger, LlamaFactory or PaLM-rlhf-pytorch?

LlamaFactory, with 62,918 lines written; PaLM-rlhf-pytorch has 3,612.

The proof: [hiyouga/LlamaFactory's code at commit 885a4ca](https://github.com/hiyouga/LlamaFactory/tree/885a4ca65cebf17a92e869af13c2ce42caca314a)

### Which has more GitHub stars, LlamaFactory or PaLM-rlhf-pytorch?

LlamaFactory, with 76,077 stars; PaLM-rlhf-pytorch has 7,863.

The proof: [hiyouga/LlamaFactory on GitHub](https://github.com/hiyouga/LlamaFactory)

### Which has more tests, LlamaFactory or PaLM-rlhf-pytorch?

LlamaFactory, with 63 test files.

The proof: [hiyouga/LlamaFactory's code at commit 885a4ca](https://github.com/hiyouga/LlamaFactory/tree/885a4ca65cebf17a92e869af13c2ce42caca314a)

### Which was updated more recently, LlamaFactory or PaLM-rlhf-pytorch?

LlamaFactory: its last push was on November 17, 2026, and PaLM-rlhf-pytorch's on September 20, 2026.

The proof: [hiyouga/LlamaFactory's commits on GitHub](https://github.com/hiyouga/LlamaFactory/commits)

### Which has more commits signed by AI, LlamaFactory or PaLM-rlhf-pytorch?

LlamaFactory: an AI signed 1.7% of its commits, with Gemini CLI, Claude Code, GitHub Copilot, and Cursor.

The proof: [the commits each tool signed in hiyouga/LlamaFactory](https://seerepo.com/r/hiyouga/LlamaFactory/ai)

## Sources

- hiyouga/LlamaFactory: Read on November 17, 2026, at commit 885a4ca (https://github.com/hiyouga/LlamaFactory/tree/885a4ca65cebf17a92e869af13c2ce42caca314a)
- lucidrains/PaLM-rlhf-pytorch: Read on November 18, 2026, at commit 68d712d (https://github.com/lucidrains/PaLM-rlhf-pytorch/tree/68d712dbd688edb4f1fd2f9b3f1d24d824f4bbeb)

## What is your repo built with?

Any public repo, with no account: https://seerepo.com/r/owner/repo/built, with the owner and name it has on GitHub.
