Skip to content
Read the original: Georgi Gerganov· Published 34/100AI score34/100

llama.cpp adds decision models via new /v1/systemone endpoint

Original titleDecision models in llama.cpp are now available

AISummary

Georgi Gerganov announced that decision models are now available in the latest llama.cpp builds through a new /v1/systemone endpoint. The endpoint supports local, private inference with multiple open models, and more are planned.

Read the original x.com

Source: Georgi Gerganov · x.comPublished · added here