Inference & performance · Concept

Reasoning budget

A configured limit or allocation for inference-time reasoning effort.

Related terms

TTFT · ITL · TPOT

Primary references

Reference definition