Evals & observability · Concept
LLM-as-a-judge
Use a model to assess outputs or execution trajectories against a rubric.
Example
Score explanations with a rubric, then compare a sample against expert judgments.
The distinction that matters
Judges can show order, style, and shared-model biases.
Related terms
Primary references
Reference definition