37 tok/s on an iPhone Air is pretty wild. 🚀
This is exactly where small, capable open models shine: strong multimodal intelligence without needing a cloud GPU. Great to see MiniCPM5-2B running smoothly on mobile.
OpenBMB reports that its MiniCPM5-2B model runs at 37 tokens per second on an iPhone Air. The post presents this as evidence that small open multimodal models can run on mobile devices without a cloud GPU, with NobodyWho noting the model is available in its Chat app.
37 tok/s on an iPhone Air is pretty wild. 🚀
This is exactly where small, capable open models shine: strong multimodal intelligence without needing a cloud GPU. Great to see MiniCPM5-2B running smoothly on mobile.
Running MiniCPM5 from @OpenBMB on iPhone Air at 37 tok/s. One of the best open models at 2B parameters, now available in the NobodyWho Chat app.
Source: OpenBMB · x.comPublished · added here