llama.cpp adds decision models via new /v1/systemone endpoint
Original titleDecision models in llama.cpp are now available
AISummary
Georgi Gerganov announced that decision models are now available in the latest llama.cpp builds through a new /v1/systemone endpoint. The endpoint supports local, private inference with multiple open models, and more are planned.
Source: Georgi Gerganov · x.comPublished · added here