Open-weight & owned stack · Training tuning
Researchers Report Budget-Efficient Mathematics Distillation
Researchers reported that decoupled knowledge distillation produced strong mathematics student models with substantially smaller training budgets.
Read the original at lacuna.tiptreesystems.comOpens the publisher's site in a new tab