Models, reasoning & training · Concept

Attention

A learned mechanism for combining information from different input positions or representations.

Related terms

Pretraining · Post-training · Base model

Primary references

Reference definition