#model distillation
1 articles tagged model distillation. At twelve articles this topic starts lifting the whole site in search.
Timeline
All articles
-
Tech · 3 min readWhat model distillation is — how big AI models teach small ones to cut costs
Definition — a small student model learns to imitate a large teacher, including the teacher's full probability distribution