Inference & performance · Concept

FlashAttention

An IO-aware exact attention algorithm designed to reduce memory traffic and improve execution efficiency.

Related terms

TTFT · ITL · TPOT

Primary references

Reference definition