Mindket

MiniCPM-o 4.5

Newversion 1 · updated

Overview

Handles images, video, speech and live audio-video streams in one 9B model, answering in text and speech in English and Chinese. For developers building voice and vision assistants.

MiniCPM-o 4.5 is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.

At a glance

You need
  • Python and pip
  • An Nvidia GPU for PyTorch use, or a runner such as llama.cpp for CPU use
  • Disk space for the weights, about 18.7 GB in BF16
Runs in
  • PyTorch on an Nvidia GPU, which the card recommends for full precision
  • llama.cpp and Ollama, for CPU use on local devices
  • vLLM and SGLang, for high-throughput serving
  • The card's open web demos on a GPU or a Mac
Start with
pip install -U huggingface_hub
hf download openbmb/MiniCPM-o-4_5

About

What it is

MiniCPM-o 4.5 is a 9B-parameter multimodal model from openbmb. It reads images, video and speech, and it can answer in text or in speech. It joins SigLip2, Whisper-medium, CosyVoice2 and Qwen3-8B into one end-to-end model.

Who it suits

Developers building assistants that see, listen and talk, and researchers who test vision and speech models. The card says it can take live video and audio while it speaks. Use voice cloning only with voices you have the right to use.

Who uses it, and how
IndustryWho uses itHow they use itExample
SoftwareAssistant buildersBuild a voice and vision assistant that runs on local hardwareA prototype answers spoken questions about what the camera sees
Document workBack-office developersParse English documents from page imagesA script turns a scanned page into text
AccessibilityApp makersDescribe a live scene aloudAn app speaks a short description of the camera view
ResearchML researchersStudy full-duplex multimodal streamingCompare instruct and thinking modes on the same prompts

Skip it if you only need plain text chat, because a text-only model is lighter to run.

Where to use it

  • PyTorch on an Nvidia GPU, which the card recommends for full precision
  • llama.cpp and Ollama, for CPU use on local devices
  • vLLM and SGLang, for high-throughput serving
  • The card's open web demos on a GPU or a Mac
Use caseWhoWhat they get back
Image and video questionsDevelopersText answers about pictures and clips
Spoken conversationApp makersReplies in speech, in English and Chinese, with configurable voices
Live streamingResearchersText and speech produced while video and audio keep arriving

How to set it up

You need Python and pip to download the files. Running it takes an Nvidia GPU for full precision, or a smaller quantized copy for local devices.

  • Python and pip
  • An Nvidia GPU for PyTorch use, or a runner such as llama.cpp for CPU use
  • Disk space for the weights, about 18.7 GB in BF16
  1. Install the Hugging Face hub library.
  2. Download the repository.
  3. Follow the card's usage steps for your chosen runner.
pip install -U huggingface_hub
hf download openbmb/MiniCPM-o-4_5

How to use it

Pick a route from the card. PyTorch on an Nvidia GPU is the basic route, while quantized copies in 16 sizes suit local devices. The card also open-sourced web demos for the live streaming experience.

ToolWhat it does
PyTorch inferenceRuns the model at full precision on an Nvidia GPU
llama.cpp and OllamaRun quantized copies efficiently on a CPU
vLLM and SGLangServe the model to many requests with less memory
Web demoGives a live streaming experience on a local GPU or Mac

Example

You open the local web demo and ask by voice what an object on your desk is. The model can look through the camera, listen, and answer in speech while the stream continues.

For newcomers and experts

If you are new, think of it as one model that can see a picture, hear you and talk back. Start with the card's web demo or a quantized copy before the full-size weights.

For people in the field, the encoders and decoders connect to the language model through hidden states instead of separate tools. The card describes a full-duplex streaming mechanism with an interleaved speech token decoder. The card gives an OpenCompass average of 77.6, a limit of 1.8 million pixels per image, and a ceiling of 10 frames per second for video.

  1. Video, audio and text arrive
  2. Encoders feed the language model
  3. The model reasons over all inputs
  4. Text and speech stream back

Good to know

Weight size in GB, 4-bit is Hugging Face's estimate
BF1618.7 GB
4-bit4.7 GB
  • License: Apache 2.0
  • Cost to run: none named, though full precision needs an Nvidia GPU
  • Data it reaches: it downloads files from Hugging Face, and live mode reads whatever camera or microphone input you give it
  • Not for: cloning a voice you have no right to use
  • The card supports more than 30 languages, with speech in English and Chinese

README and files

README

MiniCPM-o 4.5

Handles images, video, speech and live audio-video streams in one 9B model, answering in text and speech in English and Chinese. For developers building voice and vision assistants.

Made by openbmb on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.

About

What it is: MiniCPM-o 4.5 is a 9B-parameter multimodal model from openbmb. It reads images, video and speech, and it can answer in text or in speech. It joins SigLip2, Whisper-medium, CosyVoice2 and Qwen3-8B into one end-to-end model.

Who it suits: Developers building assistants that see, listen and talk, and researchers who test vision and speech models. The card says it can take live video and audio while it speaks. Use voice cloning only with voices you have the right to use.

Title: Who uses it, and how
Industry | Who uses it | How they use it | Example
Software | Assistant builders | Build a voice and vision assistant that runs on local hardware | A prototype answers spoken questions about what the camera sees
Document work | Back-office developers | Parse English documents from page images | A script turns a scanned page into text
Accessibility | App makers | Describe a live scene aloud | An app speaks a short description of the camera view
Research | ML researchers | Study full-duplex multimodal streaming | Compare instruct and thinking modes on the same prompts

Skip it if you only need plain text chat, because a text-only model is lighter to run.

Where to use it:

  • PyTorch on an Nvidia GPU, which the card recommends for full precision
  • llama.cpp and Ollama, for CPU use on local devices
  • vLLM and SGLang, for high-throughput serving
  • The card's open web demos on a GPU or a Mac
Use case | Who | What they get back
Image and video questions | Developers | Text answers about pictures and clips
Spoken conversation | App makers | Replies in speech, in English and Chinese, with configurable voices
Live streaming | Researchers | Text and speech produced while video and audio keep arriving

How to set it up: You need Python and pip to download the files. Running it takes an Nvidia GPU for full precision, or a smaller quantized copy for local devices.

  • Python and pip
  • An Nvidia GPU for PyTorch use, or a runner such as llama.cpp for CPU use
  • Disk space for the weights, about 18.7 GB in BF16
  1. Install the Hugging Face hub library.
  2. Download the repository.
  3. Follow the card's usage steps for your chosen runner.
pip install -U huggingface_hub
hf download openbmb/MiniCPM-o-4_5

How to use it: Pick a route from the card. PyTorch on an Nvidia GPU is the basic route, while quantized copies in 16 sizes suit local devices. The card also open-sourced web demos for the live streaming experience.

Tool | What it does
PyTorch inference | Runs the model at full precision on an Nvidia GPU
llama.cpp and Ollama | Run quantized copies efficiently on a CPU
vLLM and SGLang | Serve the model to many requests with less memory
Web demo | Gives a live streaming experience on a local GPU or Mac

Example: You open the local web demo and ask by voice what an object on your desk is. The model can look through the camera, listen, and answer in speech while the stream continues.

For newcomers and experts: If you are new, think of it as one model that can see a picture, hear you and talk back. Start with the card's web demo or a quantized copy before the full-size weights.

For people in the field, the encoders and decoders connect to the language model through hidden states instead of separate tools. The card describes a full-duplex streaming mechanism with an interleaved speech token decoder. The card gives an OpenCompass average of 77.6, a limit of 1.8 million pixels per image, and a ceiling of 10 frames per second for video.

Video, audio and text arrive
Encoders feed the language model
The model reasons over all inputs
Text and speech stream back

Good to know:

Title: Weight size in GB, 4-bit is Hugging Face's estimate
BF16: 18.7 GB
4-bit: 4.7 GB
  • License: Apache 2.0
  • Cost to run: none named, though full precision needs an Nvidia GPU
  • Data it reaches: it downloads files from Hugging Face, and live mode reads whatever camera or microphone input you give it
  • Not for: cloning a voice you have no right to use
  • The card supports more than 30 languages, with speech in English and Chinese

On Hugging Face, 13 November 2026

  • Task: any to any
  • Library: transformers
  • Parameters: 9.4B
  • Weights: about 18.7 GB in BF16; about 4.7 GB at 4-bit (estimate)
  • Formats: Safetensors
  • Downloads in the last 30 days: 170,793
  • Likes: 1,571
  • License: apache-2.0
  • Quantized versions: 13
  • Fine-tunes: 9
  • Tags: transformers, onnx, safetensors, minicpmo, feature-extraction, minicpm-o, minicpm-v, multimodal, full-duplex, any-to-any

Links

Get the model

Download its files with Hugging Face's command line:

pip install -U huggingface_hub
hf download openbmb/MiniCPM-o-4_5

Then follow the usage in its model card. Nothing in this kit runs by itself.

Files
README.md  5 KB

1 file, 5 KB, downloaded as a zip.

What’s new

  • Version 1 · 2026-11-12

Compare with similar

Listed Hugging Face models in the same category that share the most tags with this one.

ProductDownloads, last 30 daysLikesParametersLicenseLast change
MiniCPM-o 4.5 This page170,7931,5719.4Bapache-2.0
Realtime-VenusShares full-duplex · any-to-any · onnx2,101135—apache-2.0
MiniCPM-V 4.6Shares minicpm-v · multimodal · transformers187,5841,2531.3Bapache-2.0
MiniCPM-V-4.7-1B-ggufShares minicpm-v · multimodal168,6361141Bapache-2.0
SenseNova-U1.5-8B-MoTShares any-to-any · feature-extraction · transformers5,20127517.5Bapache-2.0
SenseNova-U1.5-8B-MoT-TailSteerShares any-to-any · feature-extraction · transformers198517.5Bapache-2.0
Numbers as Mindket last read them, from 2026-11-12 to 2026-11-13.

Reviews

No ratings yet

Write a review

No reviews yet.

What people say

Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search and on Trendshift. Mindket doesn’t write or check them. Open one to read it where it was posted.

0x1997MiniCPM-o 4.5: A Gemini Level MLLM for On-Device Mulitmodal Streaming2 pointsSung KimModel: huggingface.co/openbmb/Mini...4 likes · 1 reply猫国防MiniCPM-o-4_5: A Gemini 2.5 Flash Level MLLM for Vision, Speech, and Full-Duplex Mulitmodal Live Streaming on Your Phone Gemini 2.5 Flash等级的多模态大型语言开源模型 - 支持插入图片 - 支持语音 - 持实时视频与语音输入与回应 huggingface.co/openbmb/Mini...1 replyデイリーHuggingFaceトレンド今日のHuggingFaceトレンド openbmb/MiniCPM-o-4_5 このリポジトリは、Vision、Speech、Full-Duplexマルチモーダルライブストリーミングに対応したGemini 2.5 FlashレベルのLLMであるMiniCPM-oを公開しています。 9BパラメータでGPT-4oやGemini 2.0 Proに匹敵する性能を持ち、英語と中国語でのリアルタイム音声会話をサポートします。 ローカル環境での実行も可能です。デイリーHuggingFaceトレンド今日のHuggingFaceトレンド openbmb/MiniCPM-o-4_5 MiniCPM-oは、Vision、Speech、Full-Duplexマルチモーダルライブストリーミングを実現するGemini 2.5 FlashレベルのMLLMです。 9BパラメータでGPT-4oやGemini 2.0 Proを上回り、Gemini 2.5 Flashに匹敵する性能を持ちます。 英語と中国語でのリアルタイム音声会話、音声クローニング、ロールプレイも可能です。デイリーHuggingFaceトレンド今日のHuggingFaceトレンド openbmb/MiniCPM-o-4_5 このリポジトリは、Vision、Speech、Full-Duplex Mulitmodal Live Streamingに対応したGemini 2.5 FlashレベルのMLLM「MiniCPM-o」に関するものです。 特にMiniCPM-o 4.5は9BパラメータでGPT-4oやGemini 2.0 Proを上回る性能を持ち、リアルタイム二言語音声会話やボイスクローニング等の機能を提供します。デイリーHuggingFaceトレンド今日のHuggingFaceトレンド openbmb/MiniCPM-o-4_5 このリポジトリは、Vision、Speech、Full-Duplex Mulitmodal Live Streamingに対応したGemini 2.5 FlashレベルのMLLM「MiniCPM-o」に関するものです。 特にMiniCPM-o 4.5は9BパラメータでGPT-4oやGemini 2.0 Proを上回る性能を持ち、リアルタイム二言語音声会話やボイスクローニング等の機能を提供します。デイリーHuggingFaceトレンド今日のHuggingFaceトレンド openbmb/MiniCPM-o-4_5 このリポジトリは、Vision、Speech、Full-Duplexマルチモーダルライブストリーミングを実現するGemini 2.5 FlashレベルのMLLM「MiniCPM-o」に関するものです。 9BパラメータでGPT-4oやGemini 2.0 Proを上回る性能を持ち、英語と中国語でのリアルタイム音声会話をサポートします。 ローカル環境での実行も可能です。デイリーHuggingFaceトレンド今日のHuggingFaceトレンド openbmb/MiniCPM-o-4_5 MiniCPM-oは、視覚、音声、双方向マルチモーダルライブストリーミングに対応したGemini 2.5 Flashレベルの9Bパラメータ大規模言語モデルです。 SigLip2、Whisper、CosyVoice2、Qwen3-8Bを基盤とし、GPT-4oやGemini 2.0 Proを凌駕する性能を持ちます。 リアルタイム音声会話やボイスクローニング等の機能も提供します。

Searched

More from Mindket

See all from Mindket

anaksor-ocr

Sokheng · Kit

Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…

New

Qwen2.5-7B-Instruct as GGUF files in eight quantization sizes, to chat with locally through llama.cpp. For people who want a capable 7.6B model on their own co…

New

ACE-Step 1.5 XL SFT

ACE-Step · Kit

Generates music from text with a 4B diffusion decoder, 50 steps and guidance control, aiming for higher audio quality than the base. For creators with a GPU of…

New

Similar in Developer

See all in Developer

Claude Code Skills & Plugins

alirezarezvani · Skill

Adds 411 ready-made skills for Claude Code and other coding agents, grouped by role from engineering and product to marketing, finance and compliance. Installs…

New29.8k

buzz

block · Kit

Self-hostable workspace where people and AI agents share the same rooms, built on a Nostr relay that logs every action as a signed event. For teams that want t…

New37.3k

plannotator

backnotprop · Kit

Opens your AI coding agent's plans, specs and code changes in a browser so you can annotate or comment on them and send the feedback straight back to the agent.

New10.5k