Open-weight & owned stack · Quantization efficiency
BASE-Q Enhances Rotational LLM Quantization
BASE-Q proposed bias and asymmetric-scaling enhancements to rotational quantization for mitigating LLM weight and activation outliers.
Read the original at lacuna.tiptreesystems.comOpens the publisher's site in a new tab