Agents and harnesses · Quantization efficiency
Hearim Brings Jev Compatibility To Existing Local Models
ziozzang released hearim, an open-source gateway that uses constrained alternatives and one-token logit decoding with existing local or hosted LLMs.
Read the original at reddit.comOpens the publisher's site in a new tab