Inference & performance · Concept
Prefill
Process input tokens to establish the state used for subsequent generation.
Related terms
Primary references
Reference definition
Inference & performance · Concept
Process input tokens to establish the state used for subsequent generation.
Reference definition