Open-weight & owned stack · Quantization efficiency
llama.cpp Adds Model and Runtime Improvements
llama.cpp released version 0.4.1 with support for three models and improvements to recurrent state, KV-cache, JSON, conversion, and server handling.
Read the original at github.comOpens the publisher's site in a new tab