Inference & performance · Concept
Expert parallelism
Distribute mixture-of-experts components across devices.
Related terms
Primary references
Reference definition
Inference & performance · Concept
Distribute mixture-of-experts components across devices.
Reference definition