#Voice

AIFun-CineForge, from FunAudioLLM, is an open-source toolkit with an end-to-end dataset pipeline and an MLLM-based model for zero-shot movie dubbing across diverse cinematic scenes. The team built CineDub-CN, described as the first large-scale Chinese television dubbing dataset, and reports that its model outperforms state-of-the-art methods on audio quality, lip-sync, timbre transition, and instruction following. Inference code and checkpoints were released on March 16, 2026, and the model runs on a consumer-grade GPU.

AIMistral has released the Voxtral-Mini-4B-Realtime-2602 model weights on Hugging Face, alongside an arXiv paper and a live realtime audio playground in Mistral AI Studio. The post links these resources but provides no further benchmark figures or capability details.

AIGuillaume Lample congratulated Mistral's audio team on their work and said more would be announced soon. The post gives no model names, benchmarks, or release details.

AIMistral announces Mini Transcribe 2 via API at $0.003 per minute and a realtime transcription option at $0.006 per minute. The realtime model's open weights are published on Hugging Face, alongside a realtime demo and a blog post.

AIMistral's Voxtral Mini Transcribe 2 handles batch transcription with 4% WER on FLEURS at $0.003 per minute. It adds speaker diarization, context biasing, and word-level timestamps across 13 languages.

AIVoxtral Realtime is a natively streaming speech model for voice agents and live applications, with latency configurable down to sub-200ms. At 480ms it stays within 1-2% WER of the offline model, and the weights are released under Apache 2.0. The attached FLEURS chart compares word error rates across latency settings for ten languages, including Chinese.

AIMistral announces Voxtral 2 with two transcription models: Voxtral Realtime, released under an Apache 2 license with latency configurable to sub-200 ms, and Voxtral Mini Transcribe 2, which adds speaker diarization, word-level timestamps, and context biasing. The models support 13 languages and are available through the Mistral API, which the post describes as one of the most cost-effective transcription APIs on the market. The attached chart shows word error rates on FLEURS across Italian, Spanish, English, German, Portuguese, French, Russian, Dutch, and Chinese at several latency settings.

AIMeta introduced Oakley Meta Performance AI glasses aimed at athletes, combining a hands-free camera, Meta AI, and open-ear audio. The post frames the glasses as a way to push training to the edge, but gives no specifics on pricing, availability, or specifications.

AIMistral AI released Voxtral Mini 4B Realtime 2602, a multilingual realtime speech-transcription model with 13 supported languages under the Apache 2.0 license. The model has a configurable transcription delay from 240ms to 2.4s, and it matches leading offline open-source models at a 480ms delay. The source says it is optimized for on-device deployment and is currently supported only in vLLM.

Why it matters: The source specifies the 480ms delay operating point, 4B size, Apache 2.0 license, and vLLM serving path, which matter for teams weighing realtime transcription deployment.

AIChip Huyen praised projects at last weekend's Agentic Hackathon, which hosted by MongoDB and Cerebral Valley, where she served as a judge. Teams tackled long-running tasks such as memory management, recovery from mid-task failures, and consistency across steps and sub-agents, along with adaptive retrieval across databases, search indices, and websites. Finalist demos are scheduled in San Francisco tomorrow, with talks by Douglas Eck.

AIFunAudioLLM has released Fun-Audio-Chat-8B, a roughly 8B-parameter large audio language model for natural, low-latency voice interaction, under Apache 2.0. It uses Dual-Resolution Speech Representations with a 5Hz frame rate, which the source says reduces GPU hours by nearly 50%, and it supports English and Chinese.

AIAlibaba's FunAudioLLM released Fun-ASR-MLT-Nano-2512, an 800M-parameter multilingual speech recognition checkpoint on Hugging Face that supports 31 languages, with emphasis on East and Southeast Asian languages. It is trained on hundreds of thousands of hours of speech and is available through the FunASR toolkit. The source's benchmark tables cover the Fun-ASR family rather than this checkpoint, so no checkpoint-specific accuracy figures are reported.

AITongyi Lab has released Fun-ASR-Nano-2512, an end-to-end speech recognition large model trained on tens of millions of hours of real speech, supporting low-latency real-time transcription across 31 languages. The model, which has 800M parameters, targets industry use such as education and finance and claims 93% accuracy in far-field, high-noise conditions. It is available on Hugging Face and works with the FunASR toolkit.

AIAlibaba's FunAudioLLM has released Fun-CosyVoice3-0.5B-2512, a 0.5B-parameter LLM-based text-to-speech model on Hugging Face, with an RL variant also published. The model supports zero-shot voice cloning across 9 languages and 18+ Chinese dialects and accents, with streaming output at latency as low as 150ms. On the source's test-en benchmark, it reports a 2.24% WER and 71.8% speaker similarity, and the RL version reports 1.68% WER.