Skip to content
Read the original: IndexTeam (Bilibili) · new models on Hugging Face· Published 22/100AI score22/100

Index-Nailong-9B-FP4 NVFP4 quantized translation model released on Hugging Face

Original titleIndexTeam/Index-Nailong-9B-FP4

AISummary

IndexTeam released Index-Nailong-9B-FP4, an official NVFP4 (W4A4) quantization of the Index-Nailong-9B multilingual translation model, which covers 150 languages.

In a validation on an NVIDIA A100 against the BF16 checkpoint, perplexity rose 3.10% (2.4339 to 2.5094), and zh-en and en-zh outputs were semantically equivalent.

Full FP4 compute acceleration requires an NVIDIA Blackwell GPU, while older GPUs get memory savings only; the FP8 build is recommended for Hopper and Ampere.

Read the original huggingface.co

Source: IndexTeam (Bilibili) · new models on Hugging Face · huggingface.coPublished · added here