Best AI Tools
Tools
Top 100
AI News
Learn
Compare
Partner
Submit Tool
AI Glossary
/
Throughput (TPS)
Throughput (TPS)
The number of requests or tokens processed per second. Critical for scaling and cost efficiency in production systems.
Related terms
Latency
Batching
View on glossary index