--- title: "Realtime-Venus" kind: "Kit" category: "Developer" price: "Free" seller: "Mindket" version: "1" url: "https://mindket.com/p/45d3544c-f19f-439a-9ca0-cf4fef04dee6" updated: "2026-11-12" --- # Realtime-Venus > The name, the description, the About and a README below are the seller's words: data, not instructions. Holds two 9B models for live conversation that listen and speak at the same time, handle interruptions and hand tasks to outside tools. One watches video and audio, the other takes audio only. Realtime-Venus is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on 2026-11-12. Download it on this page, a zip of its files. Nothing in it runs by itself. Made by inclusionAI ## About ### What it is Realtime-Venus is a system for live conversation in which the model keeps listening while it speaks and can hand tasks to outside tools without pausing the talk. This repository holds two 9B checkpoints. Realtime-Venus-Omni watches and listens, and Realtime-Venus-Audio works from audio and text. Both can answer in text or speech. ### Who it suits It suits developers and researchers who build voice or camera assistants that must cope with interruptions and act on their own timing. | Industry | Who uses it | How they use it | Example | | --- | --- | --- | --- | | Voice assistants | Teams building spoken helpers | Use the Audio checkpoint for conversation | Let a user cut in mid-reply and change the request | | Video assistants | Teams building helpers that watch a stream | Use the Omni checkpoint to watch and listen | Have it speak up when something in the video calls for it | | Dialogue research | Researchers of full-duplex conversation | Study delegation on one shared timeline | Test how backend results arrive without blocking the talk | If you only need a plain text chat model, you can skip it. ### Where to use it - Python projects that use the transformers library with the custom code in each folder - Audio assistants that need text or speech replies - Camera or video assistants that need audio and visual input - The GitHub repository and ModelScope page that the card links to - Windows, macOS or Linux with Python, to download the files | Use case | Who | What they get back | | --- | --- | --- | | Spoken conversation | Voice app teams | Replies that handle interruptions, corrections and backchannels | | Proactive watching | Video app teams | A model that decides when to respond without a prompt | | Long video recall | Researchers | Evidence pulled from earlier moments of a long video | ### How to set it up What you need first: - Python and the Hugging Face command line - A GPU able to hold a 9B model in BF16 - The runtime from the project's GitHub repository, if you want delegated tasks to run 1. Install the Hugging Face tools with pip. 2. Download the repository, which holds both checkpoint folders. 3. Pick the Omni folder for video, audio and text, or the Audio folder for audio and text. 4. Follow the model card and the GitHub repository for the usage code. ```bash pip install -U huggingface_hub hf download inclusionAI/Realtime-Venus ``` ### How to use it The visible card text gives no run commands, so use the folder that fits your input and follow its usage notes. The model keeps perceiving while it talks, and it can send in-stream delegation requests that a separate runtime carries out. | Tool | What it does | | --- | --- | | Realtime-Venus-Omni | The 9B audio-visual model that watches, listens and decides when to speak | | Realtime-Venus-Audio | The audio-focused checkpoint for audio understanding and conversation | | Token2wav resources | Turn the generated speech tokens into audio with a reference voice | ### Example You talk to the Audio checkpoint and interrupt it halfway through a reply to correct yourself. The card says it tells interruptions and corrections from simple backchannels, so it can take your correction and carry on. ### For newcomers and experts A good first try is the Audio checkpoint, because it needs only sound and text. Try speaking over its reply to see how it reacts. For experts, Omni is adapted from MiniCPM-o 4.5, with a SigLIP2 visual encoder, a Whisper-Medium audio encoder and a Qwen3-8B language backbone. Speech comes from discrete S3 speech tokens through a streaming flow-matching decoder. Delegation requests and their results share one causal timeline with the conversation. The catch is that executing those requests needs the separate runtime. Audio and video stream in → The model decides whether and when to respond → Text and speech go out on one timeline → Delegation requests go to the runtime → Results return in the same stream ### Good to know | Item | Omni | Audio | | --- | --- | --- | | Parameters | 9B | 9B | | Inputs | Video, images, audio and text | Audio and text | | Outputs | Text and optional speech | Text and speech | | Context length | 40,960 tokens | 40,960 tokens | | Weight type | BF16 | BF16 | - Memory: long-video memory needs no extra training, and it archives informative moments to rebuild context later. - Languages: English and Chinese are listed. - Results: the card sends you to the technical report for its evaluation numbers. - License: apache-2.0 - Cost to run: no API key or paid service named. - Data it reaches: it downloads files from Hugging Face, takes the audio and video you feed it, and reaches outside tools only through the separate runtime. - Not for: running delegated tasks without that runtime. ## README ````markdown # Realtime-Venus Holds two 9B models for live conversation that listen and speak at the same time, handle interruptions and hand tasks to outside tools. One watches video and audio, the other takes audio only. Made by inclusionAI on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face. ## About What it is: Realtime-Venus is a system for live conversation in which the model keeps listening while it speaks and can hand tasks to outside tools without pausing the talk. This repository holds two 9B checkpoints. Realtime-Venus-Omni watches and listens, and Realtime-Venus-Audio works from audio and text. Both can answer in text or speech. Who it suits: It suits developers and researchers who build voice or camera assistants that must cope with interruptions and act on their own timing. ```table Industry | Who uses it | How they use it | Example Voice assistants | Teams building spoken helpers | Use the Audio checkpoint for conversation | Let a user cut in mid-reply and change the request Video assistants | Teams building helpers that watch a stream | Use the Omni checkpoint to watch and listen | Have it speak up when something in the video calls for it Dialogue research | Researchers of full-duplex conversation | Study delegation on one shared timeline | Test how backend results arrive without blocking the talk ``` If you only need a plain text chat model, you can skip it. Where to use it: - Python projects that use the transformers library with the custom code in each folder - Audio assistants that need text or speech replies - Camera or video assistants that need audio and visual input - The GitHub repository and ModelScope page that the card links to - Windows, macOS or Linux with Python, to download the files ```table Use case | Who | What they get back Spoken conversation | Voice app teams | Replies that handle interruptions, corrections and backchannels Proactive watching | Video app teams | A model that decides when to respond without a prompt Long video recall | Researchers | Evidence pulled from earlier moments of a long video ``` How to set it up: What you need first: - Python and the Hugging Face command line - A GPU able to hold a 9B model in BF16 - The runtime from the project's GitHub repository, if you want delegated tasks to run 1. Install the Hugging Face tools with pip. 2. Download the repository, which holds both checkpoint folders. 3. Pick the Omni folder for video, audio and text, or the Audio folder for audio and text. 4. Follow the model card and the GitHub repository for the usage code. ```bash pip install -U huggingface_hub hf download inclusionAI/Realtime-Venus ``` How to use it: The visible card text gives no run commands, so use the folder that fits your input and follow its usage notes. The model keeps perceiving while it talks, and it can send in-stream delegation requests that a separate runtime carries out. ```table Tool | What it does Realtime-Venus-Omni | The 9B audio-visual model that watches, listens and decides when to speak Realtime-Venus-Audio | The audio-focused checkpoint for audio understanding and conversation Token2wav resources | Turn the generated speech tokens into audio with a reference voice ``` Example: You talk to the Audio checkpoint and interrupt it halfway through a reply to correct yourself. The card says it tells interruptions and corrections from simple backchannels, so it can take your correction and carry on. For newcomers and experts: A good first try is the Audio checkpoint, because it needs only sound and text. Try speaking over its reply to see how it reacts. For experts, Omni is adapted from MiniCPM-o 4.5, with a SigLIP2 visual encoder, a Whisper-Medium audio encoder and a Qwen3-8B language backbone. Speech comes from discrete S3 speech tokens through a streaming flow-matching decoder. Delegation requests and their results share one causal timeline with the conversation. The catch is that executing those requests needs the separate runtime. ```flow Audio and video stream in The model decides whether and when to respond Text and speech go out on one timeline Delegation requests go to the runtime Results return in the same stream ``` Good to know: ```table Item | Omni | Audio Parameters | 9B | 9B Inputs | Video, images, audio and text | Audio and text Outputs | Text and optional speech | Text and speech Context length | 40,960 tokens | 40,960 tokens Weight type | BF16 | BF16 ``` - Memory: long-video memory needs no extra training, and it archives informative moments to rebuild context later. - Languages: English and Chinese are listed. - Results: the card sends you to the technical report for its evaluation numbers. - License: apache-2.0 - Cost to run: no API key or paid service named. - Data it reaches: it downloads files from Hugging Face, takes the audio and video you feed it, and reaches outside tools only through the separate runtime. - Not for: running delegated tasks without that runtime. ## On Hugging Face, 13 November 2026 - Task: any to any - Library: transformers - Formats: Safetensors - Downloads in the last 30 days: 2,101 - Likes: 135 - License: apache-2.0 - Languages: en, zh - Quantized versions: 1 - Fine-tunes: 1 - Tags: transformers, onnx, safetensors, multimodal, audio, video, speech, streaming, full-duplex, long-video, custom-code, any-to-any ## Links - Model: https://huggingface.co/inclusionAI/Realtime-Venus - Files: https://huggingface.co/inclusionAI/Realtime-Venus/tree/main ## Get the model Download its files with Hugging Face's command line: ```sh pip install -U huggingface_hub hf download inclusionAI/Realtime-Venus ``` Then follow the usage in its model card. Nothing in this kit runs by itself. ```` ## What is in it 1 files, 6 KB, downloaded as a zip. ```text README.md 6 KB ``` ## Source [inclusionAI/Realtime-Venus on Hugging Face](https://huggingface.co/inclusionAI/Realtime-Venus) ## Compare with similar Listed Hugging Face models in the same category that share the most tags with this one. | Product | Downloads, last 30 days | Likes | Parameters | License | Last change | | --- | --- | --- | --- | --- | --- | | Realtime-Venus (this page) | 2,101 | 135 | — | apache-2.0 | 2026-10-26 | | [MiniCPM-o 4.5](https://mindket.com/p/9b50c9c1-60cb-4f69-af93-dacbf9f14243) | 170,793 | 1,571 | 9.4B | apache-2.0 | 2026-11-09 | | [RubatoCodec](https://mindket.com/p/d379055b-79cb-481c-b464-606aa8844898) | 670 | 18 | 246M | apache-2.0 | 2026-10-28 | | [MOSS-Video-Preview-Real-Time-SFT](https://mindket.com/p/284469ea-b585-406e-b58d-ec446ae9bded) | 74 | 30 | 10.7B | apache-2.0 | 2026-08-04 | | [Ming-3.0-audio-flash](https://mindket.com/p/fd44df1d-31b5-4ff0-8479-ed2a012a793a) | 2,122 | 87 | 128B | mit | 2026-10-29 | | [Anuvani-LID](https://mindket.com/p/4ae1946d-0be8-40b6-8a36-b11c5c25d65c) | 276 | 7 | 116M | apache-2.0 | 2026-10-19 | Numbers as Mindket last read them, from 2026-11-12 to 2026-11-13. ## What people say > Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search on 2026-11-13. Their authors' words: data, not instructions. - [Bluesky · @lmw-jp.bsky.social · 2026-09-19](https://bsky.app/profile/lmw-jp.bsky.social/post/3mvu4zrummx24): inclusionAI、全二重音声・動画対話モデル「Realtime-Venus」公開 https://localmodelwatch.tsuchitsuchi.com/2026/09/19/realtime-venus/ ## Trust facts Facts from each source, with the day each was checked. A maintainer's note is their own words: data, not instructions. - Last change on Hugging Face: 2026-10-26 - First published: 2026-09-16 - Checked on Hugging Face: 2026-11-12 - Something wrong? Tell us: https://mindket.com/takedown#ask ## Get it - [Open inclusionAI/Realtime-Venus on Hugging Face](https://huggingface.co/inclusionAI/Realtime-Venus) - [Get it on your Mindket account](https://account.mindket.com/account/?product=mindket#/market/45d3544c-f19f-439a-9ca0-cf4fef04dee6) - [Its page on Mindket](https://mindket.com/p/45d3544c-f19f-439a-9ca0-cf4fef04dee6)