vLLM Semantic Router releases Decision 2.0 with open models from 0.6B to 27B
Original titleDecision 2.0 is out for vLLM Semantic Router!
AISummary
vLLM Semantic Router has released Decision 2.0, featuring open models ranging from 0.6B to 27B parameters. The models can answer 64 questions about a request in a single forward pass, are licensed under Apache-2.0, and load with Transformers.
Source: vLLM · x.comPublished · added here