Evals & observability · Concept

Eval

A systematic test of a model or application's behavior against defined criteria.

Example

Run the same refund cases before and after changing the prompt.

The distinction that matters

A narrow benchmark may miss real production failures.

Related terms

Eval suite · Regression eval · Task success rate

Primary references

Reference definition