Best AI Tools
Tools
Top 100
AI News
Learn
Compare
Partner
Submit Tool
AI Glossary
/
KV Cache (Key-Value Cache)
KV Cache (Key-Value Cache)
Cached attention key/value tensors reused across tokens or turns to reduce latency and cost in long contexts.
Related terms
Context Caching
Latency
Throughput
View on glossary index