OpenAI Evals
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
LLM evals
Open OpenAI Evals in AirStackWhat OpenAI Evals’s own pages say
| What it says it does | Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks. github.com |
|---|---|
| Integrations | Weights & Biases github.com |
| Open source | Yes github.com |
| License | make your evaluation logic and data under the same MIT license as this repository. github.com |
Each value is a quote AirStack found on the product’s own pages, read 2026-11-04. A missing field means AirStack has not found it on its pages.