Inference & performance · Concept

Tail latency

Also called: p95 · p99

The slow end of a latency distribution, commonly summarized by p95 or p99.