Models, reasoning & training · Concept

Pretraining

Broad training that establishes a model's initial representations and capabilities.

Related terms

Post-training · Base model · Instruction-tuned model

Primary references

Reference definition