Distillation: How Small Models Learn from Big Ones
What distillation is, the ways labs distill models, and how they use it on their own models and on others', from primary sources.
1 post
What distillation is, the ways labs distill models, and how they use it on their own models and on others', from primary sources.