AI projects from Hugging Face

Meta-Llama-3.1-8B-Instruct-AWQ-INT4

hugging-quants · Kit

Runs Meta's Llama 3.1 8B Instruct chat model in 4-bit AWQ form, so it fits on a GPU with about 4 GiB of free memory for the weights. For developers who want a…

Hemmingway-1.5 GGUF

bartowski · Kit

Imatrix GGUF quantizations of HemmingwayAI's Hemmingway-1.5, a 27B text model with MTP speculative decoding and a reasoning-effort prompt format. For people wh…

gemma-4-26B-A4B-it Cactus CQ

Cactus-Compute · Kit

2-bit, 3-bit and 4-bit compressed copies of Google's gemma-4-26B-A4B-it chat model in the Cactus weights format. Built to run on ARM devices through the Cactus…

Ornith-1.5-9B-GGUF by AtomicChat

AtomicChat · Kit

GGUF builds of Ornith 1.5 9B, a model that reads images and text, in sizes from 2.81 GB to 17.9 GB plus a vision projector. Pick the file that fits your graphi…

send-gate-307m

yamura4 · Kit

Checks Dutch, Flemish and English teen chat messages and returns block or allow, catching harmful terms plus shared addresses, IPs and links. For builders of c…

SmolLM3-3B-GGUF

unsloth · Kit

Chats and reasons with SmolLM3, a fully open 3B model that can think step by step or answer directly, in GGUF files by Unsloth with chat template fixes. Handle…

Qwen3-30B-A3B-GGUF by unsloth

unsloth · Kit

GGUF files of Qwen3-30B-A3B, quantized by unsloth, for running a local chat and reasoning model in llama.cpp, Ollama or Open WebUI, with a thinking mode you ca…

Llama-3.2-3B-Instruct-GGUF by unsloth

unsloth · Kit

Chats, summarizes and answers questions with Meta's compact Llama 3.2 3B instruct model, in GGUF files by Unsloth from 2-bit up to 16-bit. Small enough for ord…

Clef-LoRA-for-Qwen3.8-27B-GGUF

trevest · Kit

Adds Cloudflare Clef's decision head to a Qwen3.8-27B chat model, so one llama.cpp server on a 24 GB GPU both answers typed questions and chats. It is a LoRA a…

Llama-3.1-8B-Stheno-v3.4

Sao10K · Kit

Writes stories and plays characters in multi-turn chat. An 8B Llama 3.1 fine-tune for creative writing and roleplay, aimed at hobbyists who run models on their…

Chatterbox-Nano

ResembleAI · Kit

Speaks English text aloud on a plain CPU with a 110M-parameter model, and adds laughs and coughs through tags in the text. Suits developers who need fast on-de…

Chatterbox-Flash

ResembleAI · Kit

A zero-shot English text-to-speech model that copies a voice from a short reference clip and streams audio block by block with low latency. Suits developers bu…

Qwen3.8-27B-NVFP4 by RadixArk

RadixArk · Kit

A pre-quantized NVFP4 copy of Qwen3.8-27B that reads text, images and video and answers in text, served with SGLang on NVIDIA Blackwell GPUs. Suits developers…

Qwen3-8B-MLX-bf16

Qwen · Kit

Runs the Qwen3 8B language model through the mlx library for chat, reasoning, translation and agent work. Suits developers who want a local text model with a s…

Qwen3-30B-A3B-GGUF

Qwen · Kit

A 30.5B mixture-of-experts chat model in GGUF format with only 3.3B parameters active per token, runnable in llama.cpp or ollama. It has thinking and plain mod…

Qwen3-0.6B-GGUF

Qwen · Kit

A small 0.6B chat model in GGUF format that runs locally in llama.cpp or ollama and can switch between thinking and plain replies. Suits people with modest har…

Qwen2.5-Coder-32B-Instruct-GGUF

Qwen · Kit

GGUF copy of a 32B code chat model that runs locally with llama.cpp. It writes, explains and fixes code from plain requests, for developers who want to run it…

Qwen2.5-Coder-0.5B-Instruct

Qwen · Kit

Writes, explains and fixes code as a tiny 494M-parameter chat model with a 32,768-token context. Suits developers who want the smallest open Qwen coding model…

Qwen2.5-7B-Instruct-AWQ

Qwen · Kit

A 4-bit AWQ build of Qwen2.5-7B-Instruct, a 7.6B chat model that follows instructions, handles tables and returns JSON. For developers who want a capable chat…

Qwen2.5-14B-Instruct

Qwen · Kit

Answers questions, writes code, does maths and returns structured JSON as a 14.7B-parameter chat model with a context window up to 131,072 tokens. Suits develo…

PII-Tracer

perplexity-ai · Kit

Finds personal data in chat conversations and masks it, using a 600M-parameter encoder with a token tagger and a sensitivity score. It suits teams that clean c…

SenseNova-6.8-Code2Video GSQ-RCO GGUF

OliviaRossi · Kit

Runs a 26.9B parameter SenseNova-6.8-Code2Video model as a mixed precision GGUF file, in a terminal chat or a local server. For people who want that model on t…

DeepSeek-V4.1-Flash-NVFP4

nvidia · Kit

Reads text and images and writes text, as a smaller NVFP4 copy of DeepSeek-V4.1-Flash made by NVIDIA. For developers deploying agents, chatbots and retrieval s…

Hermes-4.3-36B-GGUF

NousResearch · Kit

A 36B hybrid reasoning model in GGUF form that can think before it answers, write valid JSON and follow your system prompt. For people who run a large model on…

Qwen2-Audio-7B-GGUF

NexaAI · Kit

Runs Qwen2-Audio locally to chat by voice and analyze audio, including speech translation, transcription and sound detection. GGUF copies for Nexa-SDK, for peo…

Agaram 2.5B

murai-labs · Kit

Chats in Tamil script, romanized Tamil and English, and translates between Tamil and English. A 2.5B model built from scratch by Murai Labs, for Tamil speakers…

JevK5-chat-mlx-4bit

mlx-community · Kit

A 4-bit MLX copy of the 4.2B JevK5 chat model for Apple Silicon, with a 262,144 token context and a small memory footprint. Made for Mac users who want a quick…

clef-flash-4bit

mlx-community · Kit

A 4-bit MLX copy of Cloudflare's clef-flash that turns a state and typed questions into a probability for every allowed answer on Apple Silicon Macs. Not a cha…

Mistral-7B-Instruct-v0.1

mistralai · Kit

A 7B instruction-tuned chat model from Mistral, fine-tuned from Mistral-7B-v0.1 on public conversation datasets. Made for developers who want a small open mode…

Phi-4

microsoft · Kit

A 14B open language model from Microsoft Research, tuned for reasoning and chat in English with limited compute. It suits developers who add text features to a…

Qwen3.8-27B-oQ8e-mtp

Jundot · Kit

Runs Qwen3.8-27B as an 8-bit mixed-precision MLX checkpoint with its vision encoder and MTP head, for image and text chat on Apple hardware. For people who wan…

MLX-Qwen3.5-0.8B-Claude-4.6-Opus-Reasoning-Distilled-6bit

Jackrong · Kit

Runs a tiny 0.8B reasoning-tuned chat model in the MLX format at 6-bit, converted from Jackrong's Qwen3.5 distilled model. For people who want a tiny local mod…

ibnsina-1.5b

ibnsina-llm · Kit

A small Persian language model for writing, summarizing, translating and chatting offline, trained from scratch mostly on Persian text. Runs through ollama, LM…

zephyr-7b-beta

HuggingFaceH4 · Kit

Chats as a helpful assistant, built by tuning Mistral-7B with direct preference optimization. For developers and hobbyists who want a small open chat model the…

PLLuM-12B-chat-2512

CYFRAGOVPL · Kit

A Polish-language chat model from the PLLuM family, tuned to human preferences for dialogue, question answering and summarization, with an eye on Polish public…

North Mini Code

CohereLabs · Kit

An open-weights research model from Cohere for writing code, agentic software engineering and terminal tasks. A 30B model with 3B active, 256K context. For dev…

granite-4.2-3b-GGUF

bartowski · Kit

Quantized GGUF copies of IBM's granite-4.2-3b text model, in many sizes from full precision down to small 3-bit files. For people who run a small chat model on…

AMALIA-9B-0626-DPO

amalia-llm · Kit

Writes and answers in European Portuguese as an open 9B chat model from Portuguese universities, tuned with supervised fine-tuning and DPO. Made for developers…

Qwen2.5-0.5B-Instruct

Qwen · Kit

Answers chat prompts as the smallest instruction-tuned Qwen2.5 model, at about 0.5B parameters. For developers who want a light local model for chat, structure…

GigaChat3.5-432B-A28B

ai-sage · Kit

Generates text in Russian and English for chat, code, reasoning and tool use. A 432B Mixture-of-Experts model with 28B active parameters, aimed at teams that h…

GigaChat3.1-10B-A1.8B-GGUF

ai-sage · Kit

Chats in Russian and English, writes code and calls functions, as a compact mixture of experts model in GGUF files. For people who run assistants on their own…

granite-4.1-8b-GGUF

unsloth · Kit

Follows instructions, calls tools and chats with IBM's Granite 4.1 8B model, in GGUF files by Unsloth that include chat template fixes. Made for business assis…

qwen-2.5-0.5b-block-transformer-hiba-wikitext2

tahamajs · Kit

Swaps 18 of the 24 attention layers in Qwen2.5-0.5B for a hierarchical block attention operator, then distills it on WikiText-2. A research checkpoint for stud…

qwen-2.5-0.5b-bam-umoe-wikitext2

tahamajs · Kit

Swaps 18 of the 24 attention layers in Qwen2.5-0.5B for a mixture-of-experts attention block, then distills it on WikiText-2. A research checkpoint for studyin…

Qwen3Guard-Stream-0.6B

Qwen · Kit

Checks text for safety token by token while a language model is still writing, rating each part safe, controversial or unsafe in 119 languages and dialects. Su…

Qwen3Guard-Gen-0.6B

Qwen · Kit

A small safety moderation model that labels a prompt or a model reply as safe, controversial or unsafe and names the risk categories, in 119 languages. Suits d…

Qwen3-1.7B-GGUF

Qwen · Kit

Gives you the small Qwen3 1.7B chat model as a q8_0 GGUF file for llama.cpp, with a switch between thinking and non-thinking replies. For people who want a lig…

Qwen3-1.7B

Qwen · Kit

A compact 1.7B chat model that switches between a thinking mode for reasoning and a quick mode for dialogue. Suits developers who want a small open model for c…

Qwen2.5-Coder-14B-Instruct

Qwen · Kit

A 14.8B code model tuned to follow instructions. It writes, explains and fixes code from plain requests, and runs through the transformers library. Suits devel…

Qwen2.5-7B-Instruct

Qwen · Kit

Chats, writes code, solves maths and returns structured JSON as a 7.6B-parameter instruction-tuned model with a context window up to 131,072 tokens. Suits deve…