Great work from the vLLM Semantic Router team on Decision 2.0.
Multiple questions about one input, answered in a single forward pass with per-option probabilities. Useful for routing and classification.
vLLM Semantic Router team releases Decision 2.0 multi-question classification models
AISummary
The vLLM Semantic Router team has released Decision 2.0, which answers multiple questions about one input in a single forward pass and outputs per-option probabilities. The post presents this as useful for routing and classification.
A quoted post from Xunzhuo Liu says Decision 2.0 includes six open decision models ranging from 0.6B to 27B parameters, each topping same-size open models on the Jev Decision Index 0.3.
Post on XView on X
@vllm_project
In every size. Decision 2.0: six open decision models, 0.6B to 27B. On the #Jev Decision Index 0.3, each one tops the same-size open models we lined it up against. #Trending collections on Hugging Face 🤗 Decision 2.0: https://huggingface.co/collections/vllm-sr/decision-20 Vela 2.0: https://huggingface.co/collections/vllm-sr/vela-20
Source: vLLM · x.comPublished · added here