Open-weight & owned stack · Quantization efficiency
Strata enables local 125-billion-parameter inference
Strata enables consumer PCs to run a 125-billion-parameter AI model locally using system RAM and GPU memory instead of cloud servers.
Read the original at opensourceforu.comOpens the publisher's site in a new tab