Best AI Tools
Tools
Top 100
AI News
Learn
Compare
Partner
Submit Tool
AI Glossary
/
Group‑Query Attention (GQA)
Group‑Query Attention (GQA)
An attention variant that shares key/value across groups of heads to reduce memory while retaining quality.
Related terms
Multi‑Query Attention (MQA)
FlashAttention
View on glossary index