Open source repos that use evaluate

10 public repos that SeeRepo read use evaluate. It's used most with transformers, datasets, and FastAPI.

Read it as markdown

Used most with

  • transformers4 repos
  • FastAPI3 repos
  • torchvision3 repos
  • Rich3 repos
evaluate10 repos
  • datasets3 repos
  • OpenAI3 repos
  • torch3 repos
  • rouge-score2 repos

The repos, by stars

  1. 1
    mlflow/mlflow

    The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

    Python+13328.8kAI 23.8%
  2. 2
    NVIDIA/TensorRT-LLM

    TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

    Python+5815kAI 1.7%
  3. 3
    EleutherAI/lm-evaluation-harness

    A framework for few-shot evaluation of language models.

    C+++314.4kAI 0.3%
  4. 4
    StarTrail-org/LEANN

    [MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

    Python+2413.8kAI 11.2%
  5. 5
    abus-aikorea/voice-pro

    Gradio WebUI for creators and developers, featuring key TTS (Edge-TTS, kokoro) and zero-shot Voice Cloning (E2 & F5-TTS, CosyVoice), with Whisper audio processing, YouTube download, Demucs vocal isolation, and multilingual translation.

    Python+2713.4kAI 5.1%
  6. 6
    axolotl-ai-cloud/axolotl

    Go ahead and axolotl questions

    Python+2612.7kAI 0.4%
  7. 7
    autogluon/autogluon

    Fast and Accurate ML in 3 Lines of Code

    Python+2110.8kAI 5%
  8. 8
    OpenDCAI/DataFlow

    [SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

    Python+308.6kAI 0.2%
  9. 9
    OptimalScale/LMFlow

    An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

    Python+328.5k
  10. 10
    ogx-ai/ogx

    Open GenAI Stack

    Python+358.5kAI 8.3%

Frequently asked questions

What is the most popular open source repo that uses evaluate?
mlflow/mlflow, with 28,820 stars on GitHub.

The proof: mlflow/mlflow on GitHub

What other technologies is evaluate used with?
With transformers (4), datasets (3), FastAPI (3), OpenAI (3), and torchvision (3), out of the 10 repos that use it.
What languages are the repos that use evaluate written in?
Python (9) and C++ (1).
How many repos that use evaluate have commits signed by AI?
9 of the 10; the most, mlflow/mlflow, with 23.8% of its commits.

The proof: the commits each tool signed in mlflow/mlflow

See inside your code, today.

Paste your repo and see it drawn, part by part: a medium one in under a minute.

Free, no account.Private repo? Sign in with GitHub

Or look inside SeeRepo's own →