Read the original: OpenBMB (MiniCPM) · new models on Hugging Face· Published · added 49/100AI score49/100
MiniCPM5-2B-Midtrain: OpenBMB releases mid-training checkpoint of 2B-class model
Original titleopenbmb/MiniCPM5-2B-Midtrain
AISummary
OpenBMB released MiniCPM5-2B-Midtrain, a BF16 mid-training checkpoint taken before SFT in the MiniCPM5-2B series, on Hugging Face and ModelScope.
The series is a 2B dense Transformer with 2,516,756,480 total parameters and a 131,072-token context length, and the final MiniCPM5-2B reports an average score of 53.9 against 51.1 for the best larger comparison model.
The release also includes GGUF, MLX, and GPTQ variants, along with the UltraData datasets.
Source: OpenBMB (MiniCPM) · new models on Hugging Face · huggingface.coPublished · added here