Models, reasoning & training · Concept

Transformer

A neural architecture built around attention and learned transformations of token representations.

Related terms

Pretraining · Post-training · Base model

Primary references

Reference definition