Evals & observability · Concept
Eval
A systematic test of a model or application's behavior against defined criteria.
Example
Run the same refund cases before and after changing the prompt.
The distinction that matters
A narrow benchmark may miss real production failures.
Related terms
Primary references
Reference definition