A Gemini 2.5 Flash Level MLLM for Vision, Speech, and Full-Duplex Mulitmodal Live Streaming on Your Phone
Modellquelle
Quellenauszug
A Gemini 2.5 Flash Level MLLM for Vision, Speech, and Full-Duplex Mulitmodal Live Streaming on Your Phone
Quellen
1 QuelleVerifiziert 1. Sept.
Modellartefakte
23 Artefakteaudio/MiniCPM-o-4_5-audio-F16.gguf
gguf · 630 MB · SHA-256 d5b188ac7fea…2ef7 · Hugging Face
HerunterladenQuellenauszüge
2 AuszügeMiniCPM-o-4_5-Q4_0.gguf
gguf · 4,45 GB · SHA-256 0df3f51f5d6f…0947 · Hugging Face
token2wav-gguf/flow_extra.gguf
gguf · 13,0 MB · SHA-256 c67611aa7d02…f78d · Hugging Face
Herunterladentoken2wav-gguf/flow_matching.gguf
gguf · 437 MB · SHA-256 eda6069f3ede…cab8 · Hugging Face
Herunterladentoken2wav-gguf/prompt_cache.gguf
gguf · 202 MB · SHA-256 81fe6f541ebe…9f2c · Hugging Face
Herunterladentts/MiniCPM-o-4_5-projector-F16.gguf
gguf · 14,3 MB · SHA-256 4b1b5b377358…d1fd · Hugging Face
Herunterladentts/MiniCPM-o-4_5-tts-F16.gguf
gguf · 1,08 GB · SHA-256 c7be3748a863…a088 · Hugging Face
Herunterladenvision/coreml_minicpmo45_vit_all_f16.mlmodelc/analytics/coremldata.bin
bin · 243 B · SHA-256 857e0e959b6f…dd48 · Hugging Face
Herunterladenvision/coreml_minicpmo45_vit_all_f16.mlmodelc/coremldata.bin
bin · 750 B · SHA-256 5270f565e75d…6e1d · Hugging Face
Herunterladenvision/coreml_minicpmo45_vit_all_f16.mlmodelc/weights/weight.bin
bin · 934 MB · SHA-256 5397257644e4…4f80 · Hugging Face
Herunterladenvision/MiniCPM-o-4_5-vision-F16.gguf
gguf · 1,02 GB · SHA-256 1453678cc4e4…f421 · Hugging Face
Herunterladen--- license: apache-2.0 pipeline_tag: any-to-any library_name: transformers tags: - minicpm-o - minicpm-v - multimodal - full-duplex base_model: openbmb/MiniCPM-o-4_5 base_model_relation: quantized --- A Gemini 2.5 Flash Level MLLM for Vision, Speech, and Full-Duplex Mulitmodal Live Streaming on Your Phone [GitHub](https://github.com/OpenBMB/MiniCPM-o) | [CookBook](https://github.com/OpenSQZ/MiniCPM-V-CookBook) | [Omni-modal Demo](https://minicpmo45.modelbest.cn/) | [Vision-Language Demo](http://211.93.21.133:18121/) </br> [WeChat](https://github.com/OpenBMB/MiniCPM-o/blob/main/docs/wechat.md) | [Discord](https://discord.gg/N2RnxGdJ) | [MiniCPM Wiki(Chinese)](https://modelbest.feishu.cn/wiki/UtWxwcERfiRIpIkBOjuc3h9tn1D) | CaseBook([Audio](https://openbmb.github.io/minicpm-o-4_5/), [Omni Full-Duplex](https://openbmb.github.io/minicpm-o-4_5-omni/)) ## News > [!NOTE] > [2026.02.06] 🥳 🥳 🥳 We open-sourced a realtime web demo deployable on your own devices like Mac or GPU. [Try it now](#deploy-a-realtime-web-demo-on-your-own-device)! ## MiniCPM-o 4.5 **MiniCPM-o 4.5** is the latest and most capable model in the MiniCPM-o series. The model is built in an end-to-end fashion based on SigLip2, Whisper-medium, CosyVoice2, and Qwen3-8B with a total of 9B parameters. It exhibits a significant performance improvement, and introduces new features for full-duplex multimodal live streaming. Notable features of MiniCPM-o 4.5 include: - 🔥 **Leading Visual Capability.** MiniCPM-o 4.5 achieves an average score of 77.6 on OpenCompass, a comprehensive evaluation of 8 popular benchmarks. **With only 9B parameters, it surpasses widely used proprietary models like GPT-4o, Gemini 2.0 Pro, and approaches Gemini 2.5 Flash** for vision-language capabilities. It supports instruct and thinking modes in a single model, better covering efficiency and performance trade-offs in different user scenarios. - 🎙 **Strong Speech Capability.** MiniCPM-o 4.5 supports **bilingual real-time speech conversation with configurable voices** in English and Chinese. It features **more natural, expressive and stable speech conversation**. The model also allows for fun features such as **voice cloning and role play via a simple reference audio clip**, where the cloning performance surpasses strong TTS tools such as CosyVoice2. - 🎬 **New Full-Duplex and Proactive Multimodal Live Streaming Cap...
Source context: 41892 downloads · 161 likes · Pipeline any-to-any · Library transformers · Repo openbmb/MiniCPM-o-4_5-gguf