AI projects from Hugging Face

VibeVoice-1.5B

microsoft · Kit

Turns written conversations into spoken audio with up to four speakers and about 90 minutes of speech, an open Microsoft text-to-speech model for research on p…

Licon MSR for LTX-2.5

LiconStudio · Kit

Keeps characters, clothing, objects and backgrounds consistent in generated video by feeding the model up to five reference images. A LoRA for LTX-2.5 in Comfy…

Mega-ASR

zhifeixie · Kit

Transcribes English and Chinese speech from noisy, echoey, clipped or overlapping recordings, and routes clean audio to the base model. For teams with difficul…

MiMo-V2.6-Pro-MOPD

XiaomiMiMo · Kit

Handles text, image, video and audio with a 1T-parameter mixture of experts tuned to repeat tool calls less in agent work. For teams that can host models of th…

Wan2.2-S2V-14B

Wan-AI · Kit

Generates cinematic video of a character driven by an audio track, and can also lip-sync existing video. For video creators, animators and researchers with a l…

AuK

tencent · Kit

A 1.5B speech model from Tencent that generates speech from text, edits recordings, and also cleans up audio and separates sources, all through plain-language…

MSST-WebUI

Sucial · Kit

Runs music source separation models from a browser page, with UVR support, preset processing flows and extra tools. For producers and audio researchers who spl…

spkrec-ecapa-voxceleb

speechbrain · Kit

Checks whether two audio recordings come from the same speaker and can output speaker embeddings, using an ECAPA-TDNN model in SpeechBrain. For developers and…

MAGI-2 Preview

sand-ai · Kit

A large audio-video generation model that makes 10-second clips with sound from a text prompt or a prompt plus a still image, refined to 1080p. For researchers…

Chatterbox-Flash

ResembleAI · Kit

A zero-shot English text-to-speech model that copies a voice from a short reference clip and streams audio block by block with low latency. Suits developers bu…

MakHam Thai TTS

pythainlp · Kit

Reads Thai text aloud in a female voice with a tiny 8 MB ONNX model that runs on a single CPU thread. For developers who need Thai speech on servers, edge devi…

Vāgdhenu by prathoshap

prathoshap · Kit

Reads classical Sanskrit verses aloud in a chant style, using one trained voice and a reference clip that sets the rhythm. For people who study, recite or need…

IndiCodec

prakharkhatri · Kit

Turns speech into two streams of compact tokens and back into 24 kHz audio at 1.09 kbps, with a focus on English and ten Indian languages. It suits speech rese…

DuDE

penguinfish1688 · Kit

Generates a two-person conversation as speech from an XML script, with turn-taking, backchannels and overlapping talk, one voice per speaker. It suits research…

HolosTTS

patriotyk · Kit

Turns Ukrainian phonemes into speech with preset voices or a voice cloned from an audio sample, as streamed 24 kHz mono audio. For developers adding Ukrainian…

MOSS-TTS

OpenMOSS-Team · Kit

Reads text aloud in eight languages with zero-shot voice cloning, long-form speech and control over pronunciation and duration. For audio producers and develop…

MOSS-Music-8B-Instruct

OpenMOSS-Team · Kit

Listens to a song and answers questions about it: lyrics with timestamps, mood and genre, key, tempo and chords, and song structure. For developers and researc…

Parakeet RNNT 1.1B

nvidia · Kit

Transcribes English speech into lowercase text. A 1.1B FastConformer Transducer model from the NVIDIA NeMo and Suno.ai teams, for developers who add speech rec…

YuE2 Particle Sliders v2

ntc-ai · Kit

Adds 16 sliders that steer the voice and genre of YuE2-3B audio generation, for people making English text to audio clips who want to shape the sound from one…

Qwen2-Audio-7B-GGUF

NexaAI · Kit

Runs Qwen2-Audio locally to chat by voice and analyze audio, including speech translation, transcription and sound detection. GGUF copies for Nexa-SDK, for peo…

Phi-4-multimodal-instruct

microsoft · Kit

Compact 5.6B model that takes text, images and audio and replies in text, with a 128K token context. For developers who want speech, vision and text in one sma…

LongCat-AudioDiT-3.5B

meituan-longcat · Kit

Turns Chinese or English text into speech with a diffusion model that works directly on the waveform latent space, and can clone a voice from a reference sampl…

SPEAR XLarge v2

marcoyang · Kit

Turns 16 kHz speech and general audio into 1280-number frame-level features, as a pretrained Zipformer encoder with about 600M parameters. For researchers who…

Gemma 4 12B IT (LiteRT-LM)

litert-community · Kit

Runs Gemma 4 12B on your own desktop with text, image and audio input, no internet needed. A LiteRT-LM build for developers who want private, on-device generat…

MMAudio_safetensors

Kijai · Kit

Provides MMAudio models in the safetensors format for Kijai's ComfyUI-MMAudio nodes, which add generated sound to video. For ComfyUI users who work with audio…

LongCap-35B-A3B-FP8

JinchuanTian · Kit

Turns recordings up to about two hours long into a timeline of speech, music and sound events with start and end times, and also transcribes speech with speake…

Ming-3.0-tts-tiny

inclusionAI · Kit

A multilingual text-to-speech model from inclusionAI that clones a voice from a short clip, designs voices from a description, and controls emotion, speed and…

Ming-3.0-audio-tiny

inclusionAI · Kit

Listens to audio with a text instruction and answers in text, with optional spoken replies. A compact audio-language model from inclusionAI for speech recognit…

Applio by IAHispano

IAHispano · Kit

A voice conversion tool with a browser interface, built for ease of use and quality, with plugin support. For artists, developers and researchers who convert o…

MOSS-Transcribe-Diarize 0.9B

hf-audio · Kit

Transcribes long recordings with several speakers in one pass, adding timestamps and anonymous speaker labels, in 50+ languages. For teams turning meetings, ca…

MuLaCover by HeartMuLa

HeartMuLa · Kit

Makes cover songs and music remixes from a reference track, lyrics and a style prompt, or from melody and chord MIDI. Writes a WAV file. For noncommercial musi…

FireRedVAD

FireRedTeam · Kit

Detects speech, singing and music in audio, with streaming and file-based voice activity detection plus audio event detection. For speech developers who segmen…

Wav2Vec2-Base-960h

facebook · Kit

Turns English speech audio sampled at 16 kHz into text. A base wav2vec 2.0 model fine-tuned on 960 hours of Librispeech, for developers and researchers who nee…

TRIBE v2

facebook · Kit

Estimates how the brain responds, as seen in fMRI, to video, audio and text, using a multimodal Transformer that maps onto the cortical surface. For neuroscien…

ARK-ASR-3B

Edge0 · Kit

Turns speech into text in many languages, with a Whisper-style audio encoder feeding a Qwen decoder. For developers and researchers who want multilingual trans…

Distil-Whisper distil-large-v3

distil-whisper · Kit

Turns English speech into text and runs about 6.3 times faster than Whisper large-v3 while staying close in accuracy on long audio. For developers and teams wh…

MOSS-Transcribe-Diarize-GGUF

cstr · Kit

Turns audio into timestamped transcripts with speaker labels in one pass. A GGUF conversion of a 0.9B model for CrispASR, for people who want meeting or interv…

Wan 2.1 for ComfyUI

Comfy-Org · Kit

Repackaged Wan 2.1 video model files for ComfyUI, covering text to video, image to video, VACE editing, camera control, alpha video and audio-driven dubbing, w…

MiniMax Music 3

Comfy-Org · Kit

Repackaged MiniMax Music 3 model files for ComfyUI, with a Text to Music workflow for making audio from a written prompt. For ComfyUI users who generate music.

Anuvani-LID

CIIL · Kit

Identifies which of India's 22 scheduled languages, or Indian English, is spoken in an audio clip, with calibrated scores. For developers building multilingual…

EMA Lightning

canberkkkkkk · Kit

A tiny Turkish text-to-speech model, 8.6M parameters and about 34 MB, that runs offline on a GPU or CPU and can stream audio as it is made. For developers who…

Mel-Band RoFormer Deux

becruily · Kit

A dual Mel-Band RoFormer model from becruily that splits a song into vocals and instrumental, with an SDR score listed for each. For non-commercial audio work.

Ming 3.0 TTS 0.5B GGUF

audio-cpp · Kit

GGUF packages of Ming 3.0 TTS 0.5B for the audio.cpp runtime: speech from text, voice cloning and voice design in seven languages, with mono 44.1 kHz output an…

DuplexJev-4B-Para

adventists-ai · Kit

Takes speech and text in, answers in text, and judges when a speaker has finished talking. Built for voice-agent developers who want a small audio model that a…

Smaug-Decisions

abacusai · Kit

Answers a typed question about audio, an image or text with a probability for each option, in one pass and with no generated text. A 4B decision model fine-tun…

VieGem-ASR

5CD-AI · Kit

Transcribes Vietnamese and mixed Vietnamese and English speech, offline or in 0.48 second streaming chunks, with a 359M-parameter model on Google's EmbeddingGe…

DaFeiYu RVC v2 40k

YukiKaze1337 · Kit

Converts a recorded speaking or singing voice into the 大肥鱼 voice, as a 40k RVC v2 model with pitch guidance. It needs an RVC inference tool and is for personal…

MiMo-V2.5-ASR

XiaomiMiMo · Kit

Transcribes speech in Mandarin, English and Cantonese, including Chinese dialects, code-switching, song lyrics, noisy audio and multi-speaker meetings, with pu…

faster-whisper-small

Systran · Kit

Whisper small converted to the CTranslate2 format so faster-whisper can transcribe audio with it. For developers who want local speech-to-text in Python.

YuE2-GGUF

Serveurperso · Kit

Pre-quantized GGUF files for yue2.cpp, a C++ song generator that turns style tags and lyrics into stereo audio plus the score it composed. For musicians and ti…