Skip to content

inclusionAI releases SingProbe streaming guardrail probe for Qwen3.5-397B-A17B

Original titleinclusionAI/Qwen3.5-397B-A17B-singprobe

AISummary

inclusionAI has released Qwen3.5-397B-A17B-singprobe, an intrinsic streaming guardrail built on Qwen/Qwen3.5-397B-A17B that scores query intent, response unsafety, and hallucination risk at every generated token using the base model's hidden states.

The probe has 8.13M parameters, taps layers 18, 38, and 58, and adds less than 0.5% decode-time overhead. Training code is available at inclusionAI/SingProbe, and the probe runs through SGLang or vLLM integration branches.

Read the original huggingface.co

Source: inclusionAI (Ant Ling) · new models on Hugging Face · huggingface.co