Models, reasoning & training · Concept

Dense model

A model whose main parameters are generally used for each token, unlike sparse expert activation.