Inference & performance · Concept

Rate limit

A restriction on request, token, concurrency, or resource consumption over a defined interval.