MiniCPM-o 4.5

The first full-duplex omni-modal large language model.

MiniCPM-o 4.5 is the latest model in the MiniCPM-o series, a 9B end-to-end omnimodal model. It can continuously receive video and audio while generating speech and text, enabling real-time interactions that see, hear, and speak simultaneously.

Model highlights:

• 🔥 Vision capability approaching Gemini 2.5 Flash. It scores 77.6 on average across 8 popular OpenCompass benchmarks. With only 9B parameters, its visual understanding surpasses GPT-4o and Gemini 2.0 Pro, and a single model supports both instruct and thinking modes.
• 🎙 Strong speech capability. It supports bilingual real-time speech conversation with configurable voices in English and Chinese, making conversations more natural, expressive, and stable. A simple reference audio clip is enough for voice cloning and role play, and its voice cloning performance surpasses strong TTS tools such as CosyVoice2.
• 🎬 Full-duplex, proactive live interaction. It processes real-time, continuous video and audio input streams simultaneously while generating concurrent text and speech output streams in an end-to-end fashion, without mutual blocking. This allows MiniCPM-o 4.5 to see, hear, and speak simultaneously, enabling smooth, real-time omnimodal conversations. Beyond responding to requests, the model can also interact proactively, for example by initiating reminders or comments based on its continuous understanding of the scene.

Official introduction