Open-weight & owned stack · Training tuning
Researchers propose normalized low-rank adaptation
The NoRA proposal normalizes LoRA’s down-projection matrix along the rank dimension as an alternative low-rank adaptation method.
Read the original at ritvik19.medium.comOpens the publisher's site in a new tab