Knowledge Distillation

Transferring knowledge from a large teacher model to a smaller student to improve efficiency.

Related terms