Open-weight & owned stack · Quantization efficiency
Edge0 Demonstrates SSD-Resident MoE Serving
Edge0 reported serving 35-billion-parameter mixture-of-experts models from SSD on consumer hardware using hybrid-precision quantization.
Read the original at huggingface.coOpens the publisher's site in a new tab