Open-weight & owned stack · Training tuning
Researchers Propose Diversity-Aware Reverse-KL Distillation
A paper proposes a diversity-aware reverse-KL objective intended to address limitations of existing LLM distillation losses in large-vocabulary settings.
Read the original at awesomepapers.ioOpens the publisher's site in a new tab