Novita AI open-sources Chord, a W4A16 MoE kernel for Kimi K2.x on vLLM

Novita AI has open-sourced Chord, a W4A16 MoE CUDA operator with BF16 activations, INT4 weights and group-32 scales, built for Kimi K2.x serving shapes.

Measured per layer against public Humming, it reports 1.11–1.20x on H200 EP8 prefill, 1.17–1.33x on H200 TP8 serving, and 1.81–2.15x on B300 EP8 decode against an untuned Humming default.

Integration of the grouped operators with vLLM's Humming backend is still a work in progress.