#Model distillation
2 articles tagged Model distillation. At twelve articles this topic starts lifting the whole site in search.
Timeline
-
What is a distillation attack? Copying an AI by mining its answers — Anthropic says it cut the haul 90-99%
-
What model distillation is — how big AI models teach small ones to cut costs
All articles
-
Tech · 2 min readWhat is a distillation attack? Copying an AI by mining its answers — Anthropic says it cut the haul 90-99%
Definition — mining a rival model's outputs via API to train a copy; same technique as distillation, without permission
-
Tech · 3 min readWhat model distillation is — how big AI models teach small ones to cut costs
Definition — a small student model learns to imitate a large teacher, including the teacher's full probability distribution