Read the original: IndexTeam (Bilibili) · new models on Hugging Face· Published · added · 6d ago29/100AI score29/100
Index-Homura-2B-FP4 released as NVFP4 quantized translation model
Original titleIndexTeam/Index-Homura-2B-FP4
AISummary
IndexTeam released Index-Homura-2B-FP4, an official NVFP4 (W4A4) quantization of its Index-Homura-2B multilingual translation model, which supports 150 languages.
The quantized checkpoint shows a 5.73% perplexity increase over the BF16 original (3.5011 to 3.7017) on a fixed corpus, and its zh-en and en-zh outputs are semantically equivalent under greedy decoding.
Full FP4 acceleration requires an NVIDIA Blackwell GPU, while the source recommends the FP8 build for Hopper and Ampere hardware.
Source: IndexTeam (Bilibili) · new models on Hugging Face · huggingface.coPublished · added here