Evals & observability · Concept

Cost optimization

Reducing execution spend while preserving the required outcome quality, latency, reliability, and coverage.

Example

Compare cheaper routing or shorter context against cost per successful task and the failures those changes introduce.

The distinction that matters

Lower spend can trade against quality, latency, reliability, or coverage; measure the outcome as well as the bill.

Related terms

Cost per successful task · Eval suite · LLMOps

Primary references

Reference definition