Open-weight & owned stack · Quantization efficiency
InfoQuant Shapes Activations For Low-Bit Quantization
InfoQuant proposed activation-distribution shaping to improve uniform low-bit LLM quantization and released code.
Read the original at awesomepapers.ioOpens the publisher's site in a new tab