AI projects from Hugging Face

Meta-Llama-3.1-8B-Instruct-AWQ-INT4

hugging-quants · Kit

Runs Meta's Llama 3.1 8B Instruct chat model in 4-bit AWQ form, so it fits on a GPU with about 4 GiB of free memory for the weights. For developers who want a…

Hemmingway-1.5 GGUF

bartowski · Kit

Imatrix GGUF quantizations of HemmingwayAI's Hemmingway-1.5, a 27B text model with MTP speculative decoding and a reasoning-effort prompt format. For people wh…

gemma-4-26B-A4B-it Cactus CQ

Cactus-Compute · Kit

2-bit, 3-bit and 4-bit compressed copies of Google's gemma-4-26B-A4B-it chat model in the Cactus weights format. Built to run on ARM devices through the Cactus…

Ornith-1.5-9B-GGUF by AtomicChat

AtomicChat · Kit

GGUF builds of Ornith 1.5 9B, a model that reads images and text, in sizes from 2.81 GB to 17.9 GB plus a vision projector. Pick the file that fits your graphi…

send-gate-307m

yamura4 · Kit

Checks Dutch, Flemish and English teen chat messages and returns block or allow, catching harmful terms plus shared addresses, IPs and links. For builders of c…

SmolLM3-3B-GGUF

unsloth · Kit

Chats and reasons with SmolLM3, a fully open 3B model that can think step by step or answer directly, in GGUF files by Unsloth with chat template fixes. Handle…

Qwen3-30B-A3B-GGUF by unsloth

unsloth · Kit

GGUF files of Qwen3-30B-A3B, quantized by unsloth, for running a local chat and reasoning model in llama.cpp, Ollama or Open WebUI, with a thinking mode you ca…

Llama-3.2-3B-Instruct-GGUF by unsloth

unsloth · Kit

Chats, summarizes and answers questions with Meta's compact Llama 3.2 3B instruct model, in GGUF files by Unsloth from 2-bit up to 16-bit. Small enough for ord…

Clef-LoRA-for-Qwen3.8-27B-GGUF

trevest · Kit

Adds Cloudflare Clef's decision head to a Qwen3.8-27B chat model, so one llama.cpp server on a 24 GB GPU both answers typed questions and chats. It is a LoRA a…

Llama-3.1-8B-Stheno-v3.4

Sao10K · Kit

Writes stories and plays characters in multi-turn chat. An 8B Llama 3.1 fine-tune for creative writing and roleplay, aimed at hobbyists who run models on their…

Chatterbox-Nano

ResembleAI · Kit

Speaks English text aloud on a plain CPU with a 110M-parameter model, and adds laughs and coughs through tags in the text. Suits developers who need fast on-de…

Chatterbox-Flash

ResembleAI · Kit

A zero-shot English text-to-speech model that copies a voice from a short reference clip and streams audio block by block with low latency. Suits developers bu…

Qwen3.8-27B-NVFP4 by RadixArk

RadixArk · Kit

A pre-quantized NVFP4 copy of Qwen3.8-27B that reads text, images and video and answers in text, served with SGLang on NVIDIA Blackwell GPUs. Suits developers…

Qwen3-8B-MLX-bf16

Qwen · Kit

Runs the Qwen3 8B language model through the mlx library for chat, reasoning, translation and agent work. Suits developers who want a local text model with a s…

Qwen3-30B-A3B-GGUF

Qwen · Kit

A 30.5B mixture-of-experts chat model in GGUF format with only 3.3B parameters active per token, runnable in llama.cpp or ollama. It has thinking and plain mod…

Qwen3-0.6B-GGUF

Qwen · Kit

A small 0.6B chat model in GGUF format that runs locally in llama.cpp or ollama and can switch between thinking and plain replies. Suits people with modest har…

Qwen2.5-Coder-32B-Instruct-GGUF

Qwen · Kit

GGUF copy of a 32B code chat model that runs locally with llama.cpp. It writes, explains and fixes code from plain requests, for developers who want to run it…

Qwen2.5-Coder-0.5B-Instruct

Qwen · Kit

Writes, explains and fixes code as a tiny 494M-parameter chat model with a 32,768-token context. Suits developers who want the smallest open Qwen coding model…

Qwen2.5-7B-Instruct-AWQ

Qwen · Kit

A 4-bit AWQ build of Qwen2.5-7B-Instruct, a 7.6B chat model that follows instructions, handles tables and returns JSON. For developers who want a capable chat…

Qwen2.5-14B-Instruct

Qwen · Kit

Answers questions, writes code, does maths and returns structured JSON as a 14.7B-parameter chat model with a context window up to 131,072 tokens. Suits develo…

PII-Tracer

perplexity-ai · Kit

Finds personal data in chat conversations and masks it, using a 600M-parameter encoder with a token tagger and a sensitivity score. It suits teams that clean c…

SenseNova-6.8-Code2Video GSQ-RCO GGUF

OliviaRossi · Kit

Runs a 26.9B parameter SenseNova-6.8-Code2Video model as a mixed precision GGUF file, in a terminal chat or a local server. For people who want that model on t…

DeepSeek-V4.1-Flash-NVFP4

nvidia · Kit

Reads text and images and writes text, as a smaller NVFP4 copy of DeepSeek-V4.1-Flash made by NVIDIA. For developers deploying agents, chatbots and retrieval s…

Hermes-4.3-36B-GGUF

NousResearch · Kit

A 36B hybrid reasoning model in GGUF form that can think before it answers, write valid JSON and follow your system prompt. For people who run a large model on…

Qwen2-Audio-7B-GGUF

NexaAI · Kit

Runs Qwen2-Audio locally to chat by voice and analyze audio, including speech translation, transcription and sound detection. GGUF copies for Nexa-SDK, for peo…

Agaram 2.5B

murai-labs · Kit

Chats in Tamil script, romanized Tamil and English, and translates between Tamil and English. A 2.5B model built from scratch by Murai Labs, for Tamil speakers…

JevK5-chat-mlx-4bit

mlx-community · Kit

A 4-bit MLX copy of the 4.2B JevK5 chat model for Apple Silicon, with a 262,144 token context and a small memory footprint. Made for Mac users who want a quick…

clef-flash-4bit

mlx-community · Kit

A 4-bit MLX copy of Cloudflare's clef-flash that turns a state and typed questions into a probability for every allowed answer on Apple Silicon Macs. Not a cha…

Mistral-7B-Instruct-v0.1

mistralai · Kit

A 7B instruction-tuned chat model from Mistral, fine-tuned from Mistral-7B-v0.1 on public conversation datasets. Made for developers who want a small open mode…

Phi-4

microsoft · Kit

A 14B open language model from Microsoft Research, tuned for reasoning and chat in English with limited compute. It suits developers who add text features to a…

Qwen3.8-27B-oQ8e-mtp

Jundot · Kit

Runs Qwen3.8-27B as an 8-bit mixed-precision MLX checkpoint with its vision encoder and MTP head, for image and text chat on Apple hardware. For people who wan…

MLX-Qwen3.5-0.8B-Claude-4.6-Opus-Reasoning-Distilled-6bit

Jackrong · Kit

Runs a tiny 0.8B reasoning-tuned chat model in the MLX format at 6-bit, converted from Jackrong's Qwen3.5 distilled model. For people who want a tiny local mod…

ibnsina-1.5b

ibnsina-llm · Kit

A small Persian language model for writing, summarizing, translating and chatting offline, trained from scratch mostly on Persian text. Runs through ollama, LM…

zephyr-7b-beta

HuggingFaceH4 · Kit

Chats as a helpful assistant, built by tuning Mistral-7B with direct preference optimization. For developers and hobbyists who want a small open chat model the…

PLLuM-12B-chat-2512

CYFRAGOVPL · Kit

A Polish-language chat model from the PLLuM family, tuned to human preferences for dialogue, question answering and summarization, with an eye on Polish public…

North Mini Code

CohereLabs · Kit

An open-weights research model from Cohere for writing code, agentic software engineering and terminal tasks. A 30B model with 3B active, 256K context. For dev…

granite-4.2-3b-GGUF

bartowski · Kit

Quantized GGUF copies of IBM's granite-4.2-3b text model, in many sizes from full precision down to small 3-bit files. For people who run a small chat model on…

AMALIA-9B-0626-DPO

amalia-llm · Kit

Writes and answers in European Portuguese as an open 9B chat model from Portuguese universities, tuned with supervised fine-tuning and DPO. Made for developers…

Qwen2.5-0.5B-Instruct

Qwen · Kit

Answers chat prompts as the smallest instruction-tuned Qwen2.5 model, at about 0.5B parameters. For developers who want a light local model for chat, structure…

GigaChat3.5-432B-A28B

ai-sage · Kit

Generates text in Russian and English for chat, code, reasoning and tool use. A 432B Mixture-of-Experts model with 28B active parameters, aimed at teams that h…

GigaChat3.1-10B-A1.8B-GGUF

ai-sage · Kit

Chats in Russian and English, writes code and calls functions, as a compact mixture of experts model in GGUF files. For people who run assistants on their own…

granite-4.1-8b-GGUF

unsloth · Kit

Follows instructions, calls tools and chats with IBM's Granite 4.1 8B model, in GGUF files by Unsloth that include chat template fixes. Made for business assis…

qwen-2.5-0.5b-block-transformer-hiba-wikitext2

tahamajs · Kit

Swaps 18 of the 24 attention layers in Qwen2.5-0.5B for a hierarchical block attention operator, then distills it on WikiText-2. A research checkpoint for stud…

qwen-2.5-0.5b-bam-umoe-wikitext2

tahamajs · Kit

Swaps 18 of the 24 attention layers in Qwen2.5-0.5B for a mixture-of-experts attention block, then distills it on WikiText-2. A research checkpoint for studyin…

Qwen3Guard-Stream-0.6B

Qwen · Kit

Checks text for safety token by token while a language model is still writing, rating each part safe, controversial or unsafe in 119 languages and dialects. Su…

Qwen3Guard-Gen-0.6B

Qwen · Kit

A small safety moderation model that labels a prompt or a model reply as safe, controversial or unsafe and names the risk categories, in 119 languages. Suits d…

Qwen3-1.7B-GGUF

Qwen · Kit

Gives you the small Qwen3 1.7B chat model as a q8_0 GGUF file for llama.cpp, with a switch between thinking and non-thinking replies. For people who want a lig…

Qwen3-1.7B

Qwen · Kit

A compact 1.7B chat model that switches between a thinking mode for reasoning and a quick mode for dialogue. Suits developers who want a small open model for c…

Qwen2.5-Coder-14B-Instruct

Qwen · Kit

A 14.8B code model tuned to follow instructions. It writes, explains and fixes code from plain requests, and runs through the transformers library. Suits devel…

Qwen2.5-7B-Instruct

Qwen · Kit

Chats, writes code, solves maths and returns structured JSON as a 7.6B-parameter instruction-tuned model with a context window up to 131,072 tokens. Suits deve…

Qwen2 0.5B Instruct

Qwen · Kit

A small 494M-parameter chat model from Qwen that follows instructions, with weights of about 988 MB in BF16 that run through Transformers. It suits developers…

Hermes-3-Llama-3.2-3B

NousResearch · Kit

A 3.2B chat and assistant model that follows instructions, calls functions, writes structured output and code. For developers and hobbyists who run a model on…

phi-2

microsoft · Kit

A small text generation model that answers questions, continues chat dialogue and completes code. Made for researchers and developers who want a compact open m…

Qwen3.8-27B-DFlash2 by incoai

incoai · Kit

Speeds up Qwen3.8-27B by drafting blocks of tokens that the main model then checks, with output unchanged. A 1.9B draft model for SGLang and vLLM servers, not…

granite-4.2-3b

ibm-granite · Kit

Reasons step by step before it answers, with tool calling, code generation and multilingual chat, in a compact 3B model from IBM. Supports a 128K context nativ…

SmolLM2-360M-Instruct

HuggingFaceTB · Kit

Answers chat-style questions and handles rewriting and summaries with a 362M-parameter instruction-tuned model that runs on modest hardware. For developers who…

Carbon-X

HuggingFaceBio · Kit

Reads raw DNA inside a chat and answers in English, judging whether variants look benign or pathogenic, for researchers who want a DNA language model on their…

Crystal-31B-RL

hiwaifu-research · Kit

A role-play chat model post-trained from Gemma 4 31B-IT that replies in the user's language, whether Russian, Spanish, English or Portuguese, and stays in it.…

DeepSeek-V3.2

deepseek-ai · Kit

A 685B open reasoning model from DeepSeek with sparse attention for long context and a chat template that lets it think while it calls tools. For teams that ru…

Meta-Llama-3.1-8B-Instruct-GGUF

bartowski · Kit

Quantized GGUF files of Meta's Llama 3.1 8B Instruct for local chat, such as 4.92 GB for Q4_K_M and 8.54 GB for Q8_0. Made by bartowski with an importance matr…

Llama-3.2-3B-Instruct-GGUF

bartowski · Kit

GGUF quantizations of Meta's Llama-3.2-3B-Instruct, made by bartowski with an importance matrix, from about 1.8 GB to 6.4 GB. For running a small chat model lo…

Qwen3.8-27B-CodeForge-3xMerge

xtools-at · Kit

Writes and explains code and works through reasoning problems, from a weighted merge of three Qwen3.8-27B fine-tunes. For developers who want one general-purpo…

Llama-3.2-1B-Instruct-GGUF

unsloth · Kit

Chats, summarizes and answers questions in text on a laptop, as Unsloth's GGUF copy of Meta's small Llama 3.2 1B Instruct in precisions from 16-bit to 2-bit. F…

MNN-Pocket-0.3B-MNN

taobao-mnn · Kit

Runs a 0.3B Chinese and English chat model on phones and edge devices through the MNN runtime, as a 4-bit build of about 173 MB. For developers adding on-devic…

MNN-Pocket-0.3B-Dec

taobao-mnn · Kit

Reads a text state plus your questions and picks one of your options for each, with a probability per candidate, in a single pass. A decision model for develop…

Chatterbox-Turbo

ResembleAI · Kit

Speaks English text aloud with a 350M-parameter model built for low-latency voice agents, and adds laughs and coughs through tags in the text. Suits developers…

Qwen3.5-4B-Base

Qwen · Kit

Gives researchers a pre-trained-only vision-language base model for fine-tuning and in-context learning experiments, not for direct chat. Suits developers who…

Qwen3-4B-GGUF

Qwen · Kit

A 4B chat model in GGUF format that runs locally in llama.cpp or ollama, with a thinking mode for reasoning and a plain mode for quick replies. Suits developer…

Qwen3-14B

Qwen · Kit

Reasons through hard problems in a thinking mode and answers everyday chat in a faster non-thinking mode, as a 14.8B-parameter open model. Suits developers who…

Qwen2.5-Coder-32B-Instruct

Qwen · Kit

Writes, explains and fixes code as the largest instruction-tuned model in the Qwen2.5-Coder family, at 32B parameters. For developers who run a strong open cod…

Qwen2.5-Coder-14B-Instruct-GGUF

Qwen · Kit

Gives you the Qwen2.5-Coder 14B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp. For developers who want a stronger lo…

Qwen2.5-Coder-1.5B-Instruct-GGUF

Qwen · Kit

Gives you the small Qwen2.5-Coder 1.5B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp on a laptop. For developers who…

SillyTavern

nohurry · Kit

Shares roleplay presets for SillyTavern, mainly the Voyage series plus a generic Eval preset. It suits people who run story chats with local or hosted language…

Granite-4.2-30B

ibm-granite · Kit

Works through a problem in steps before it answers, for math, code, tool calling and multilingual chat. IBM's largest dense Granite 4.2 model, under Apache 2.0…

SmolLM2-135M-Instruct

HuggingFaceTB · Kit

Answers chat-style questions and handles rewriting and summaries with a 135M-parameter instruction-tuned model small enough for on-device use. For developers w…

SmolLM2-1.7B-Instruct

HuggingFaceTB · Kit

Chats, rewrites and summarizes text and can call functions, in a compact 1.7B model small enough to run on-device. The instruction-tuned SmolLM2 from HuggingFa…

gnani-evon-v3.3-30B-A3B

gnani · Kit

Chats, answers questions and reasons in English and ten Indic languages with a 128K context. A 30B mixture-of-experts model from Gnani.ai, for teams building a…

RWKV7-G1 GooseOne

BlinkDL · Kit

Pure RNN text-generation base models for chat, reasoning and tool calls, meant as a starting point for post-training and fine-tuning. Covers eight languages, f…

Spark-X2.6-4B GGUF

bartowski · Kit

Small English and Chinese chat model as GGUF files from full bf16 down to about 2.4 GB, for llama.cpp, with a low or high thinking setting. For developers who…

Rick & Morty Bot

kingabzpro · Kit

Chats back in the voice of Rick from Rick and Morty, using a DialoGPT model in a Gradio page. A character chat demo for fans and for developers who want a smal…

Qwen3-4B-Instruct-2507

Qwen · Kit

Answers chat prompts with a 4B model that skips visible thinking and reads up to 256K tokens of context. For developers who want a small open assistant for rea…

Qwen2.5-Coder-7B-Instruct

Qwen · Kit

Writes, explains and fixes code as a 7B instruction-tuned member of the Qwen2.5-Coder family. For developers who want a capable open coding model that fits on…

Qwen2.5-1.5B-Instruct-GGUF

Qwen · Kit

Gives you the small Qwen2.5 1.5B chat model as GGUF files in eight quantization sizes, for running with llama.cpp on a laptop or modest GPU. For people who wan…

Qwen2.5-1.5B-Instruct

Qwen · Kit

A small 1.5B chat model from Qwen that follows instructions, writes code and math, returns structured output such as JSON and handles over 29 languages. For de…

Hermes 4 14B

NousResearch · Kit

A 14B hybrid reasoning model from Nous Research, built on Qwen3-14B. It can think step by step, call tools, and return JSON that follows a schema. It uses the…

Hermes-3-Llama-3.1-8B-GGUF

NousResearch · Kit

Runs Hermes 3, an 8B general-purpose chat model from NousResearch, as a quantized GGUF file for llama.cpp. Suits people who want a local assistant with functio…

Hermes 3 Llama-3.1 8B

NousResearch · Kit

An 8B general-purpose chat model from Nous Research, built on Llama 3.1, with function calling, structured output, role play and code help. It suits developers…

WPLM

Leejh123e · Kit

A small chat bot whose weights were written by hand as a plain-text edit list, with no training at all. You can follow each reply back to the neurons behind it…

Hemmingway-1

HemmingwayAI · Kit

Writes everyday messages and emails as one ready-to-send text instead of a list of options. A 27B model built on Qwen3.8-27B, free for non-commercial use, for…

Gadsby-4B

errrinn · Kit

Chats in a quirky chat-speak voice after a ban on word pairs common in Simple Wikipedia. A 4.3B-parameter Gemma 3 experiment for people curious about constrain…

Sekai-1

8BitStudio · Kit

A 95.6M-parameter English chat model trained from scratch on one RTX 5060 Ti, small enough to run on a CPU. For people who want a tiny local language model to…

mai_replier-9b-v3

tcmofashi · Kit

Plays a persona in Chinese QQ group chats by reading the chat history and writing one short, casual reply with no visible reasoning. A merged 9B fine-tune of Q…

Qwen3.5-35B-A3B

Qwen · Kit

A multimodal chat model that reads images and text, with 35B parameters of which 3B are active at a time. For developers who host their own large model with Tr…

Qwen Sharp Chat Templates

peculiar-ragdoll · Kit

Replaces the chat template of Qwen3.5, 3.6 and 3.8 models so they think less before answering and write tighter replies. For people running Qwen locally for co…

Mistral-7B-Instruct-v0.3

mistralai · Kit

A 7.2B open chat model from Mistral AI that follows instructions and can call functions you describe. It is fine-tuned from Mistral-7B-v0.3 and runs with mistr…

Raon-1 mini (GGUF)

KRAFTON · Kit

Runs a 28.8B mixture-of-experts model tuned for Korean chat, reasoning and tool-using agents in llama.cpp. GGUF copy of Raon-1 mini preview for people who run…

Granite-4.2-8B

ibm-granite · Kit

Reasons step by step, writes code, calls tools and chats in several languages with a context of up to 128K tokens, extendable to 512K. IBM's dense 8B model, fo…

CherryPit-1.2-2B

DRUPEs · Kit

A 2B coding and chat model built on MiniCPM5-2B that is much better at web apps needing several features in one component. For developers who want a small loca…

Tallow

digi-the-robot · Kit

A tiny 15.7M-parameter language model that plays a wild crow, answering with moods, actions and crow sounds and remembering how you treat him. For tinkerers an…

TinyLlama-1.1B-Chat-v1.0

TinyLlama · Kit

Chats in plain text as a small 1.1B language model that runs with little memory. For developers and researchers who want a compact chat model built on a Llama-…