AI projects from Hugging Face

VibeVoice-1.5B

microsoft · Kit

Turns written conversations into spoken audio with up to four speakers and about 90 minutes of speech, an open Microsoft text-to-speech model for research on p…

Licon MSR for LTX-2.5

LiconStudio · Kit

Keeps characters, clothing, objects and backgrounds consistent in generated video by feeding the model up to five reference images. A LoRA for LTX-2.5 in Comfy…

Mega-ASR

zhifeixie · Kit

Transcribes English and Chinese speech from noisy, echoey, clipped or overlapping recordings, and routes clean audio to the base model. For teams with difficul…

MiMo-V2.6-Pro-MOPD

XiaomiMiMo · Kit

Handles text, image, video and audio with a 1T-parameter mixture of experts tuned to repeat tool calls less in agent work. For teams that can host models of th…

Wan2.2-S2V-14B

Wan-AI · Kit

Generates cinematic video of a character driven by an audio track, and can also lip-sync existing video. For video creators, animators and researchers with a l…

AuK

tencent · Kit

A 1.5B speech model from Tencent that generates speech from text, edits recordings, and also cleans up audio and separates sources, all through plain-language…

MSST-WebUI

Sucial · Kit

Runs music source separation models from a browser page, with UVR support, preset processing flows and extra tools. For producers and audio researchers who spl…

spkrec-ecapa-voxceleb

speechbrain · Kit

Checks whether two audio recordings come from the same speaker and can output speaker embeddings, using an ECAPA-TDNN model in SpeechBrain. For developers and…

MAGI-2 Preview

sand-ai · Kit

A large audio-video generation model that makes 10-second clips with sound from a text prompt or a prompt plus a still image, refined to 1080p. For researchers…

Chatterbox-Flash

ResembleAI · Kit

A zero-shot English text-to-speech model that copies a voice from a short reference clip and streams audio block by block with low latency. Suits developers bu…

MakHam Thai TTS

pythainlp · Kit

Reads Thai text aloud in a female voice with a tiny 8 MB ONNX model that runs on a single CPU thread. For developers who need Thai speech on servers, edge devi…

Vāgdhenu by prathoshap

prathoshap · Kit

Reads classical Sanskrit verses aloud in a chant style, using one trained voice and a reference clip that sets the rhythm. For people who study, recite or need…

IndiCodec

prakharkhatri · Kit

Turns speech into two streams of compact tokens and back into 24 kHz audio at 1.09 kbps, with a focus on English and ten Indian languages. It suits speech rese…

DuDE

penguinfish1688 · Kit

Generates a two-person conversation as speech from an XML script, with turn-taking, backchannels and overlapping talk, one voice per speaker. It suits research…

HolosTTS

patriotyk · Kit

Turns Ukrainian phonemes into speech with preset voices or a voice cloned from an audio sample, as streamed 24 kHz mono audio. For developers adding Ukrainian…

MOSS-TTS

OpenMOSS-Team · Kit

Reads text aloud in eight languages with zero-shot voice cloning, long-form speech and control over pronunciation and duration. For audio producers and develop…

MOSS-Music-8B-Instruct

OpenMOSS-Team · Kit

Listens to a song and answers questions about it: lyrics with timestamps, mood and genre, key, tempo and chords, and song structure. For developers and researc…

Parakeet RNNT 1.1B

nvidia · Kit

Transcribes English speech into lowercase text. A 1.1B FastConformer Transducer model from the NVIDIA NeMo and Suno.ai teams, for developers who add speech rec…

YuE2 Particle Sliders v2

ntc-ai · Kit

Adds 16 sliders that steer the voice and genre of YuE2-3B audio generation, for people making English text to audio clips who want to shape the sound from one…

Qwen2-Audio-7B-GGUF

NexaAI · Kit

Runs Qwen2-Audio locally to chat by voice and analyze audio, including speech translation, transcription and sound detection. GGUF copies for Nexa-SDK, for peo…

Phi-4-multimodal-instruct

microsoft · Kit

Compact 5.6B model that takes text, images and audio and replies in text, with a 128K token context. For developers who want speech, vision and text in one sma…

LongCat-AudioDiT-3.5B

meituan-longcat · Kit

Turns Chinese or English text into speech with a diffusion model that works directly on the waveform latent space, and can clone a voice from a reference sampl…

SPEAR XLarge v2

marcoyang · Kit

Turns 16 kHz speech and general audio into 1280-number frame-level features, as a pretrained Zipformer encoder with about 600M parameters. For researchers who…

Gemma 4 12B IT (LiteRT-LM)

litert-community · Kit

Runs Gemma 4 12B on your own desktop with text, image and audio input, no internet needed. A LiteRT-LM build for developers who want private, on-device generat…

MMAudio_safetensors

Kijai · Kit

Provides MMAudio models in the safetensors format for Kijai's ComfyUI-MMAudio nodes, which add generated sound to video. For ComfyUI users who work with audio…

LongCap-35B-A3B-FP8

JinchuanTian · Kit

Turns recordings up to about two hours long into a timeline of speech, music and sound events with start and end times, and also transcribes speech with speake…

Ming-3.0-tts-tiny

inclusionAI · Kit

A multilingual text-to-speech model from inclusionAI that clones a voice from a short clip, designs voices from a description, and controls emotion, speed and…

Ming-3.0-audio-tiny

inclusionAI · Kit

Listens to audio with a text instruction and answers in text, with optional spoken replies. A compact audio-language model from inclusionAI for speech recognit…

Applio by IAHispano

IAHispano · Kit

A voice conversion tool with a browser interface, built for ease of use and quality, with plugin support. For artists, developers and researchers who convert o…

MOSS-Transcribe-Diarize 0.9B

hf-audio · Kit

Transcribes long recordings with several speakers in one pass, adding timestamps and anonymous speaker labels, in 50+ languages. For teams turning meetings, ca…

MuLaCover by HeartMuLa

HeartMuLa · Kit

Makes cover songs and music remixes from a reference track, lyrics and a style prompt, or from melody and chord MIDI. Writes a WAV file. For noncommercial musi…

FireRedVAD

FireRedTeam · Kit

Detects speech, singing and music in audio, with streaming and file-based voice activity detection plus audio event detection. For speech developers who segmen…

Wav2Vec2-Base-960h

facebook · Kit

Turns English speech audio sampled at 16 kHz into text. A base wav2vec 2.0 model fine-tuned on 960 hours of Librispeech, for developers and researchers who nee…

TRIBE v2

facebook · Kit

Estimates how the brain responds, as seen in fMRI, to video, audio and text, using a multimodal Transformer that maps onto the cortical surface. For neuroscien…

ARK-ASR-3B

Edge0 · Kit

Turns speech into text in many languages, with a Whisper-style audio encoder feeding a Qwen decoder. For developers and researchers who want multilingual trans…

Distil-Whisper distil-large-v3

distil-whisper · Kit

Turns English speech into text and runs about 6.3 times faster than Whisper large-v3 while staying close in accuracy on long audio. For developers and teams wh…

MOSS-Transcribe-Diarize-GGUF

cstr · Kit

Turns audio into timestamped transcripts with speaker labels in one pass. A GGUF conversion of a 0.9B model for CrispASR, for people who want meeting or interv…

Wan 2.1 for ComfyUI

Comfy-Org · Kit

Repackaged Wan 2.1 video model files for ComfyUI, covering text to video, image to video, VACE editing, camera control, alpha video and audio-driven dubbing, w…

MiniMax Music 3

Comfy-Org · Kit

Repackaged MiniMax Music 3 model files for ComfyUI, with a Text to Music workflow for making audio from a written prompt. For ComfyUI users who generate music.

Anuvani-LID

CIIL · Kit

Identifies which of India's 22 scheduled languages, or Indian English, is spoken in an audio clip, with calibrated scores. For developers building multilingual…

EMA Lightning

canberkkkkkk · Kit

A tiny Turkish text-to-speech model, 8.6M parameters and about 34 MB, that runs offline on a GPU or CPU and can stream audio as it is made. For developers who…

Mel-Band RoFormer Deux

becruily · Kit

A dual Mel-Band RoFormer model from becruily that splits a song into vocals and instrumental, with an SDR score listed for each. For non-commercial audio work.

Ming 3.0 TTS 0.5B GGUF

audio-cpp · Kit

GGUF packages of Ming 3.0 TTS 0.5B for the audio.cpp runtime: speech from text, voice cloning and voice design in seven languages, with mono 44.1 kHz output an…

DuplexJev-4B-Para

adventists-ai · Kit

Takes speech and text in, answers in text, and judges when a speaker has finished talking. Built for voice-agent developers who want a small audio model that a…

Smaug-Decisions

abacusai · Kit

Answers a typed question about audio, an image or text with a probability for each option, in one pass and with no generated text. A 4B decision model fine-tun…

VieGem-ASR

5CD-AI · Kit

Transcribes Vietnamese and mixed Vietnamese and English speech, offline or in 0.48 second streaming chunks, with a 359M-parameter model on Google's EmbeddingGe…

DaFeiYu RVC v2 40k

YukiKaze1337 · Kit

Converts a recorded speaking or singing voice into the 大肥鱼 voice, as a 40k RVC v2 model with pitch guidance. It needs an RVC inference tool and is for personal…

MiMo-V2.5-ASR

XiaomiMiMo · Kit

Transcribes speech in Mandarin, English and Cantonese, including Chinese dialects, code-switching, song lyrics, noisy audio and multi-speaker meetings, with pu…

faster-whisper-small

Systran · Kit

Whisper small converted to the CTranslate2 format so faster-whisper can transcribe audio with it. For developers who want local speech-to-text in Python.

YuE2-GGUF

Serveurperso · Kit

Pre-quantized GGUF files for yue2.cpp, a C++ song generator that turns style tags and lyrics into stereo audio plus the score it composed. For musicians and ti…

Haas-ja-v1.0-GGUF

sakasegawa · Kit

GGUF files of a Japanese speech recognition model that run only in speech.cpp, on macOS, Windows, Linux or the CPU alone. For people who transcribe Japanese au…

turn-1-mini

p99lab · Kit

Detects when a speaker has finished talking and when someone is cutting in, using audio alone on a CPU in real time. It suits builders of voice agents and call…

NVIDIA NemotronLabs RE-USE-laughter

nvidia · Kit

Cleans noisy speech recordings in many languages while keeping laughter. A 9.6M parameter enhancement model for creators who fix audio and researchers who prep…

whisper-persian-v4

nezamisafa · Kit

Turns Persian speech into text. It is a fine-tune of Whisper large v3 on a Persian dataset, for developers and teams that transcribe Persian audio.

YuE2-hum-to-song

Mothersuperior · Kit

Turns a hummed melody of 10 to 30 seconds, plus a style line and lyrics, into a full song that follows your tune. An add-on for the YuE2-3B music model, for so…

Pocket TTS

kyutai · Kit

A 100M-parameter text-to-speech model from Kyutai that runs on CPUs in six languages, streams audio with about 200 ms to the first chunk, and works from Python…

phonon-31m English for audio.cpp

gradium · Kit

Speaks English text aloud on a CPU from a 31M text-to-speech model in GGUF form, for the audio.cpp runtime. Made for developers who want a small local voice mo…

Hy-Nomas x LTX-2.5 Audio Workflows

BennyDaBall · Kit

Two ComfyUI workflows that add a soundtrack to silent Hy-Nomas video worlds or any clip, using the stock LTX-2.5 distilled model while the picture stays untouc…

whisperkit-coreml

argmaxinc · Kit

Holds Core ML speech recognition models for WhisperKit, which turns audio into text on Apple Silicon without a server. Made for Apple app developers who want t…

GigaAM-v3

ai-sage · Kit

Turns Russian speech into text, with variants that add punctuation and normalized text, built on a Conformer of about 230M parameters. For developers and teams…

ACE-Step 1.5 XL Turbo

ACE-Step · Kit

Generates music and other audio in just 8 steps with a 4B-parameter diffusion model, run locally through a Gradio interface. For creators and developers with a…

RubatoCodec

third-intelligence · Kit

Compresses speech into a fixed number of variable-length events with durations, and decodes them back as it streams. A neural speech codec for people building…

Inkling-Small-NVFP4

thinkingmachines · Kit

The NVFP4 copy of Inkling-Small, a multimodal mixture-of-experts model that takes text, images and audio and writes text. For developers building agents, codin…

wespeaker-voxceleb-resnet34-LM

pyannote · Kit

Turns a voice recording into a speaker embedding with a pyannote.audio wrapper around the WeSpeaker ResNet34 model, so you can compare how alike two speakers s…

Pipecat backchannel detector

pipecat-ai · Kit

Listens to a user while a voice bot is talking and tells apart a quick "mm-hmm" from a real interruption, so the bot keeps going or stops. A tiny streaming aud…

Kokoro-82M-v1.0-ONNX

onnx-community · Kit

Turns English text into spoken audio with Kokoro, an 82 million parameter text-to-speech model packaged as ONNX files for JavaScript and Python. For developers…

YuE2 instrumental cot full LoRAs

Mothersuperior · Kit

LoRA add-on for the YuE2-3B music model that makes it write instrumental tracks following a section plan such as intro, verse and chorus. For musicians already…

MERT-v2-FullSong

m-a-p · Kit

A music encoder that turns whole songs of 30 to 360 seconds into numeric features at frame or recording level. It suits music AI researchers and developers wor…

Mimi

kyutai · Kit

A neural audio codec from Kyutai that squeezes speech into compact audio tokens and decodes them back. It suits researchers and developers building speech lang…

granite-speech-5.0-2b

ibm-granite · Kit

Turns speech into text in six languages and translates speech to and from English, with keyword biasing and language prompting. A compact 2B speech-language mo…

FireRedLID

FireRedTeam · Kit

Identifies which language is spoken in an audio clip, across 100+ languages and 20+ Chinese dialects and accents. The language ID module of FireRedASR2S, for s…

VoxLock

arbazsiddiqui · Kit

Keeps the caller's voice and removes other voices from call audio before speech-to-text hears them. A 27.3M-parameter open model that streams on a CPU, with fi…

Russian Emotional TTS

Andreevai · Kit

Speaks Russian text with emotion and marked word stress, and can copy a voice from a 3 to 10 second clip. Clone only voices you have the right to use.

faster-whisper-large-v3

Systran · Kit

Turns speech in audio files into timestamped text, as OpenAI's Whisper large-v3 converted for CTranslate2 and faster-whisper. For developers who transcribe rec…

Jev-Omni

akhilaaa3 · Kit

Answers a question about text, an image, audio or video by giving a probability for each option you list, instead of writing an explanation. A 12B classifier b…

MiMo-V2.6-Flash-RL

XiaomiMiMo · Kit

Handles text, image, video and audio input in one model, with a 1M-token context for long repositories and agent runs. An open 311B mixture-of-experts model fr…

orukqwen-asr-1.7b

oruk · Kit

Turns English speech into text. It is Qwen3-ASR-1.7B post-trained by reinforcement learning on word error rate, for developers and speech researchers who need…

English_audio_transcriptor

Sakil · Kit

Turns spoken English into text with the wav2vec2 base model in a Gradio page, with four example dialogue clips included. For students, developers and anyone wh…

Persian ASR

SajjadAyoubi · Kit

Turns spoken Persian into text with a wav2vec2 speech model in a Gradio page. For students, developers and anyone who needs a transcript of Persian audio.

ESPNet2 ASR Librispeech word vs bpe tokens

jkang · Kit

Compares three English speech recognition models from one ESPnet2 Conformer setup, using bpe, character and word tokens, in a Gradio page with example audio. F…

ESPNet2 ASR Librispeech Conformer (100h)

jkang · Kit

Transcribes English speech to text with an ESPnet2 Conformer model trained on 100 hours of Librispeech, in a Gradio page with example audio. For speech researc…

DeepFilterNet

hshr · Kit

Cleans background noise out of speech audio with DeepFilterNet in a Gradio page, with sample clips included. For anyone tidying voice recordings and for audio…

Tabla Transcriber

HridayKharpude · Kit

Works on tabla audio with a saved model in a Gradio page, with sample recordings named after tabla rhythms. For tabla students and music-tech hobbyists.

embeddinggemma-2-740m-litert-lm

litert-community · Kit

The 740M multimodal EmbeddingGemma 2 packaged for on-device use with LiteRT-LM. It maps text, code, images, video and audio into one shared 768-dimensional vec…

Kandinsky S2V 1.0 Lite

kandinskylab · Kit

Turns one reference picture and a speech recording into a talking avatar video, animating the whole figure to match the audio. For researchers and developers w…

Realtime-Venus

inclusionAI · Kit

Holds two 9B models for live conversation that listen and speak at the same time, handle interruptions and hand tasks to outside tools. One watches video and a…

Ming-3.0-audio-flash

inclusionAI · Kit

Listens to audio plus a text instruction and returns text, or text with synthesized speech. Covers speech recognition, spoken questions and audio reasoning in…

ZeroTTS

zeroweight-ai · Kit

Reads Vietnamese text aloud in real time on a laptop CPU, with streaming output and voice cloning from a few seconds of reference audio. For developers adding…

CLAP2-L

laion · Kit

A 340M-parameter audio-text model from LAION that places sounds and English text in one embedding space, for zero-shot audio classification, audio-text search…

gemma-4-12B-it

google · Kit

Takes text, images and audio and writes text answers, in one 12B instruction-tuned model from Google DeepMind with a 256K-token context and configurable thinki…

gemma-4-12b-it-GGUF

unsloth · Kit

Unsloth's GGUF quantized copy of Google's instruction-tuned Gemma 4 12B, a model that takes text, images, audio and video and writes text, for running locally.

embeddinggemma-2-GGUF

unsloth · Kit

Turns text into 768-dimensional vectors for on-device search, retrieval and clustering. The base model also covers images, video and audio. Packaged as GGUF by…

MOSS-Transcribe-Diarize

OpenMOSS-Team · Kit

Turns long recordings of several speakers into one timestamped transcript with anonymous speaker labels in a single pass, for teams that transcribe meetings, c…

LongCat-Next

meituan-longcat · Kit

Native multimodal model that handles text, images and audio as discrete tokens in one system, with 74.3B parameters. For researchers and developers building ap…

SheetSage2

m-a-p · Kit

Turns a music recording into an editable lead sheet with melody, chords, beats, key and structure, as ABC and MIDI files plus timed notes. A 57.2M model built…

gemma-4-E2B

google · Kit

Handles text, image and audio input and writes text, in a small Gemma 4 model built for laptops and phones. From Google DeepMind, with 2.3B effective parameter…

MiniCPM-o 4.5

openbmb · Kit

Handles images, video, speech and live audio-video streams in one 9B model, answering in text and speech in English and Chinese. For developers building voice…

AADD

gertelrina · Kit

Detects 12 kinds of audio degradation in speech recordings every 20 ms, such as noise, reverb, clipping and codec artefacts. Meant for cleaning speech datasets…

ACE-Step 1.5

ACE-Step · Kit

Generates full songs from a text description, with a language model that plans lyrics and structure and a diffusion transformer that renders the audio. Built t…

Nemotron 3 Diarization

nvidia · Kit

Works out who spoke when in a recording, with up to eight speakers, in streaming or offline mode, and can add speaker labels to a transcript. For people who pr…