Meta-Llama-3.1-8B-Instruct-AWQ-INT4
hugging-quants · Kit
Runs Meta's Llama 3.1 8B Instruct chat model in 4-bit AWQ form, so it fits on a GPU with about 4 GiB of free memory for the weights. For developers who want a…
New
AI skills and agents for developers
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Categories and filters
Listings
Dodaios
Dodaios · Kit
Open source agent OS that lets you steer coding agents, your browser and other desktop apps by voice or chat, with every system change waiting for your approva…
New369
gemma-4-26B-A4B-it Cactus CQ
Cactus-Compute · Kit
2-bit, 3-bit and 4-bit compressed copies of Google's gemma-4-26B-A4B-it chat model in the Cactus weights format. Built to run on ARM devices through the Cactus…
New
Ornith-1.5-9B-GGUF by AtomicChat
AtomicChat · Kit
GGUF builds of Ornith 1.5 9B, a model that reads images and text, in sizes from 2.81 GB to 17.9 GB plus a vision projector. Pick the file that fits your graphi…
New
send-gate-307m
yamura4 · Kit
Checks Dutch, Flemish and English teen chat messages and returns block or allow, catching harmful terms plus shared addresses, IPs and links. For builders of c…
New
SmolLM3-3B-GGUF
unsloth · Kit
Chats and reasons with SmolLM3, a fully open 3B model that can think step by step or answer directly, in GGUF files by Unsloth with chat template fixes. Handle…
New
Qwen3-30B-A3B-GGUF by unsloth
unsloth · Kit
GGUF files of Qwen3-30B-A3B, quantized by unsloth, for running a local chat and reasoning model in llama.cpp, Ollama or Open WebUI, with a thinking mode you ca…
New
Llama-3.2-3B-Instruct-GGUF by unsloth
unsloth · Kit
Chats, summarizes and answers questions with Meta's compact Llama 3.2 3B instruct model, in GGUF files by Unsloth from 2-bit up to 16-bit. Small enough for ord…
New
Clef-LoRA-for-Qwen3.8-27B-GGUF
trevest · Kit
Adds Cloudflare Clef's decision head to a Qwen3.8-27B chat model, so one llama.cpp server on a 24 GB GPU both answers typed questions and chats. It is a LoRA a…
New
Chatterbox-Nano
ResembleAI · Kit
Speaks English text aloud on a plain CPU with a 110M-parameter model, and adds laughs and coughs through tags in the text. Suits developers who need fast on-de…
New
Chatterbox-Flash
ResembleAI · Kit
A zero-shot English text-to-speech model that copies a voice from a short reference clip and streams audio block by block with low latency. Suits developers bu…
New
Qwen3.8-27B-NVFP4 by RadixArk
RadixArk · Kit
A pre-quantized NVFP4 copy of Qwen3.8-27B that reads text, images and video and answers in text, served with SGLang on NVIDIA Blackwell GPUs. Suits developers…
New
Qwen3-8B-MLX-bf16
Qwen · Kit
Runs the Qwen3 8B language model through the mlx library for chat, reasoning, translation and agent work. Suits developers who want a local text model with a s…
New
Qwen3-30B-A3B-GGUF
Qwen · Kit
A 30.5B mixture-of-experts chat model in GGUF format with only 3.3B parameters active per token, runnable in llama.cpp or ollama. It has thinking and plain mod…
New
Qwen3-0.6B-GGUF
Qwen · Kit
A small 0.6B chat model in GGUF format that runs locally in llama.cpp or ollama and can switch between thinking and plain replies. Suits people with modest har…
New
Qwen2.5-Coder-32B-Instruct-GGUF
Qwen · Kit
GGUF copy of a 32B code chat model that runs locally with llama.cpp. It writes, explains and fixes code from plain requests, for developers who want to run it…
New
Qwen2.5-Coder-0.5B-Instruct
Qwen · Kit
Writes, explains and fixes code as a tiny 494M-parameter chat model with a 32,768-token context. Suits developers who want the smallest open Qwen coding model…
New
Qwen2.5-7B-Instruct-AWQ
Qwen · Kit
A 4-bit AWQ build of Qwen2.5-7B-Instruct, a 7.6B chat model that follows instructions, handles tables and returns JSON. For developers who want a capable chat…
New
Qwen2.5-14B-Instruct
Qwen · Kit
Answers questions, writes code, does maths and returns structured JSON as a 14.7B-parameter chat model with a context window up to 131,072 tokens. Suits develo…
New
SenseNova-6.8-Code2Video GSQ-RCO GGUF
OliviaRossi · Kit
Runs a 26.9B parameter SenseNova-6.8-Code2Video model as a mixed precision GGUF file, in a terminal chat or a local server. For people who want that model on t…
New
DeepSeek-V4.1-Flash-NVFP4
nvidia · Kit
Reads text and images and writes text, as a smaller NVFP4 copy of DeepSeek-V4.1-Flash made by NVIDIA. For developers deploying agents, chatbots and retrieval s…
New
JevK5-chat-mlx-4bit
mlx-community · Kit
A 4-bit MLX copy of the 4.2B JevK5 chat model for Apple Silicon, with a 262,144 token context and a small memory footprint. Made for Mac users who want a quick…
New
clef-flash-4bit
mlx-community · Kit
A 4-bit MLX copy of Cloudflare's clef-flash that turns a state and typed questions into a probability for every allowed answer on Apple Silicon Macs. Not a cha…
New
Mistral-7B-Instruct-v0.1
mistralai · Kit
A 7B instruction-tuned chat model from Mistral, fine-tuned from Mistral-7B-v0.1 on public conversation datasets. Made for developers who want a small open mode…
New
Phi-4
microsoft · Kit
A 14B open language model from Microsoft Research, tuned for reasoning and chat in English with limited compute. It suits developers who add text features to a…
New
Qwen3.8-27B-oQ8e-mtp
Jundot · Kit
Runs Qwen3.8-27B as an 8-bit mixed-precision MLX checkpoint with its vision encoder and MTP head, for image and text chat on Apple hardware. For people who wan…
New
Runs a tiny 0.8B reasoning-tuned chat model in the MLX format at 6-bit, converted from Jackrong's Qwen3.5 distilled model. For people who want a tiny local mod…
New
PLLuM-12B-chat-2512
CYFRAGOVPL · Kit
A Polish-language chat model from the PLLuM family, tuned to human preferences for dialogue, question answering and summarization, with an eye on Polish public…
New
granite-4.2-3b-GGUF
bartowski · Kit
Quantized GGUF copies of IBM's granite-4.2-3b text model, in many sizes from full precision down to small 3-bit files. For people who run a small chat model on…
New
Qwen2.5-0.5B-Instruct
Qwen · Kit
Answers chat prompts as the smallest instruction-tuned Qwen2.5 model, at about 0.5B parameters. For developers who want a light local model for chat, structure…
New
GigaChat3.5-432B-A28B
ai-sage · Kit
Generates text in Russian and English for chat, code, reasoning and tool use. A 432B Mixture-of-Experts model with 28B active parameters, aimed at teams that h…
New
granite-4.1-8b-GGUF
unsloth · Kit
Follows instructions, calls tools and chats with IBM's Granite 4.1 8B model, in GGUF files by Unsloth that include chat template fixes. Made for business assis…
New
Qwen3Guard-Stream-0.6B
Qwen · Kit
Checks text for safety token by token while a language model is still writing, rating each part safe, controversial or unsafe in 119 languages and dialects. Su…
New
Qwen3Guard-Gen-0.6B
Qwen · Kit
A small safety moderation model that labels a prompt or a model reply as safe, controversial or unsafe and names the risk categories, in 119 languages. Suits d…
New
Qwen3-1.7B-GGUF
Qwen · Kit
Gives you the small Qwen3 1.7B chat model as a q8_0 GGUF file for llama.cpp, with a switch between thinking and non-thinking replies. For people who want a lig…
New
Qwen3-1.7B
Qwen · Kit
A compact 1.7B chat model that switches between a thinking mode for reasoning and a quick mode for dialogue. Suits developers who want a small open model for c…
New
Qwen2.5-7B-Instruct
Qwen · Kit
Chats, writes code, solves maths and returns structured JSON as a 7.6B-parameter instruction-tuned model with a context window up to 131,072 tokens. Suits deve…
New
Qwen2 0.5B Instruct
Qwen · Kit
A small 494M-parameter chat model from Qwen that follows instructions, with weights of about 988 MB in BF16 that run through Transformers. It suits developers…
New
Hermes-3-Llama-3.2-3B
NousResearch · Kit
A 3.2B chat and assistant model that follows instructions, calls functions, writes structured output and code. For developers and hobbyists who run a model on…
New
phi-2
microsoft · Kit
A small text generation model that answers questions, continues chat dialogue and completes code. Made for researchers and developers who want a compact open m…
New
Qwen3.8-27B-DFlash2 by incoai
incoai · Kit
Speeds up Qwen3.8-27B by drafting blocks of tokens that the main model then checks, with output unchanged. A 1.9B draft model for SGLang and vLLM servers, not…
New
granite-4.2-3b
ibm-granite · Kit
Reasons step by step before it answers, with tool calling, code generation and multilingual chat, in a compact 3B model from IBM. Supports a 128K context nativ…
New
SmolLM2-360M-Instruct
HuggingFaceTB · Kit
Answers chat-style questions and handles rewriting and summaries with a 362M-parameter instruction-tuned model that runs on modest hardware. For developers who…
New
DeepSeek-V3.2
deepseek-ai · Kit
A 685B open reasoning model from DeepSeek with sparse attention for long context and a chat template that lets it think while it calls tools. For teams that ru…
New
Meta-Llama-3.1-8B-Instruct-GGUF
bartowski · Kit
Quantized GGUF files of Meta's Llama 3.1 8B Instruct for local chat, such as 4.92 GB for Q4_K_M and 8.54 GB for Q8_0. Made by bartowski with an importance matr…
New
Llama-3.2-3B-Instruct-GGUF
bartowski · Kit
GGUF quantizations of Meta's Llama-3.2-3B-Instruct, made by bartowski with an importance matrix, from about 1.8 GB to 6.4 GB. For running a small chat model lo…
New
Qwen3.8-27B-CodeForge-3xMerge
xtools-at · Kit
Writes and explains code and works through reasoning problems, from a weighted merge of three Qwen3.8-27B fine-tunes. For developers who want one general-purpo…
New
Llama-3.2-1B-Instruct-GGUF
unsloth · Kit
Chats, summarizes and answers questions in text on a laptop, as Unsloth's GGUF copy of Meta's small Llama 3.2 1B Instruct in precisions from 16-bit to 2-bit. F…
New
MNN-Pocket-0.3B-MNN
taobao-mnn · Kit
Runs a 0.3B Chinese and English chat model on phones and edge devices through the MNN runtime, as a 4-bit build of about 173 MB. For developers adding on-devic…
New
MNN-Pocket-0.3B-Dec
taobao-mnn · Kit
Reads a text state plus your questions and picks one of your options for each, with a probability per candidate, in a single pass. A decision model for develop…
New