Read the original: IndexTeam (Bilibili) · new models on Hugging Face· Published · added · 6d ago22/100AI score22/100
Index-Nailong-9B-FP4 NVFP4 quantized translation model released on Hugging Face
Original titleIndexTeam/Index-Nailong-9B-FP4
AISummary
IndexTeam released Index-Nailong-9B-FP4, an official NVFP4 (W4A4) quantization of the Index-Nailong-9B multilingual translation model, which covers 150 languages.
In a validation on an NVIDIA A100 against the BF16 checkpoint, perplexity rose 3.10% (2.4339 to 2.5094), and zh-en and en-zh outputs were semantically equivalent.
Full FP4 compute acceleration requires an NVIDIA Blackwell GPU, while older GPUs get memory savings only; the FP8 build is recommended for Hopper and Ampere.
Source: IndexTeam (Bilibili) · new models on Hugging Face · huggingface.coPublished · added here