AI skills and agents for developers

Qwen2.5-7B-Instruct-GGUF by Qwen

Qwen · Kit

Qwen2.5-7B-Instruct as GGUF files in eight quantization sizes, to chat with locally through llama.cpp. For people who want a capable 7.6B model on their own co…

officialmobai_Rostam-S1-4B-GGUF

bartowski · Kit

GGUF quantizations of Rostam-S1-4B, a 4B reasoning model for math, physics, software work and Persian-English text. For people who run small models locally and…

Hemmingway-1.5 GGUF

bartowski · Kit

Imatrix GGUF quantizations of HemmingwayAI's Hemmingway-1.5, a 27B text model with MTP speculative decoding and a reasoning-effort prompt format. For people wh…

AsteroRank-Lepton-GGUF

Asteromorph · Kit

Ranks search results by relevance with a reranker for STEM and general search, shipped as GGUF files for llama.cpp. For developers and researchers who want loc…

GLiNER2.5 Base

fastino · Kit

Pulls entities, relations and structured records out of English text, and classifies it, from one schema, running locally on CPU, CUDA or MPS. It suits develop…

Ornith-1.5-9B-GGUF by AtomicChat

AtomicChat · Kit

GGUF builds of Ornith 1.5 9B, a model that reads images and text, in sizes from 2.81 GB to 17.9 GB plus a vision projector. Pick the file that fits your graphi…

Qwen3.5-4B-3D-Coder-GGUF

prithivMLmods · Kit

Writes code and builds interactive 3D scenes as self-contained Three.js pages, using GGUF copies of an early-preview Qwen3.5-4B fine-tune. For developers who p…

MOSS-Image-IDM-2-Steps

akhaliq · Kit

Makes images from text in two steps with no guidance pass, as a small adapter for MOSS-Image-SFT, plus a second adapter for light image edits. Made for people…

Qwen3.8-27B-DFlash2-GGUF by z-lab

z-lab · Kit

A draft model in GGUF form that speeds up Qwen3.8-27B by proposing token blocks for the main model to verify. For people who run that model locally with llama.…

LocalAlign_llama3.1_8B

yuyangGong · Kit

A LoRA adapter for Llama-3.1-8B-Instruct that trains it to follow trusted instructions and ignore commands hidden in external data. A prompt injection defense…

Spark-X2.6-1.7B-Base

XHToken · Kit

A compact 1.7B language model for on-device use in English and Chinese, with gains in coding, agent tasks and long context, and three adjustable thinking level…

Qwen3.6-27B-GGUF

unsloth · Kit

Handles agentic coding and image-plus-text tasks locally, as Unsloth's GGUF files for Qwen3.6-27B with thinking preservation and a long context. For developers…

Qwen3.5-4B-MTP-GGUF

unsloth · Kit

Unsloth's GGUF files of Qwen3.5-4B with multi-token prediction, which lets llama.cpp use speculative decoding for roughly 1.5 to 2 times faster generation. For…

Qwen3-30B-A3B-GGUF by unsloth

unsloth · Kit

GGUF files of Qwen3-30B-A3B, quantized by unsloth, for running a local chat and reasoning model in llama.cpp, Ollama or Open WebUI, with a thinking mode you ca…

Qwen3-14B-GGUF

unsloth · Kit

Gives you Qwen3 14B, a text generation model that can think through hard questions or answer fast, as GGUF files for your own computer. Packaged by unsloth for…

Qwen2.5-Coder-7B-Instruct-GGUF by unsloth

unsloth · Kit

Writes, explains and fixes code on your own computer, as Unsloth's GGUF copy of the Qwen2.5-Coder 7B instruction model. For developers who want a local coding…

Olmo-3-32B-Think-GGUF

unsloth · Kit

Gives you Olmo 3 32B Think, a 32.2B-parameter reasoning model, as GGUF files that run on your own computer. Packaged by unsloth for people who want a local mod…

gemma-3-270m-it-GGUF

unsloth · Kit

Generates text from prompts as a 268M instruction-tuned Gemma 3 model in GGUF format, small enough for laptops and desktops. For developers who want a tiny loc…

Sweep Next-Edit 1.5B (GGUF)

sweepai · Kit

Predicts your next code edit from the open file, recent diffs and current state, running locally as a 1.5B Q8_0 GGUF model. For developers who want edit autoco…

Qwen3-TTS GGUF

Serveurperso · Kit

Speaks text in several languages with named speakers and Mandarin dialects, and can clone a voice from a short clip, through the qwentts.cpp C++ runtime on CPU…

Qwen3-4B P9 Honeypot

samliumay · Kit

A small research adapter for Qwen3-4B that turns the model into a decoy. It sends a silent alert to a local collector when it spots an attack on its secrets, t…

Unlimited-OCR-2-GGUF

RX5950XT · Kit

GGUF files of the Unlimited-OCR-2 document OCR model in BF16, Q8_0 and Q4_K_M, with a vision projector. They run only in a llama.cpp build with the repository'…

Flint INT4

RecursiveSI · Kit

A 4-bit MLX copy of Recursive Flint for local use on Apple Silicon, about 22.6 GB, launched through Rec with pi or OpenCode. Suits Mac users and developers who…

Qwen3.8-27B-mixed-3.5bpw-MLX

rapid-mlx · Kit

A 27B vision-language model compressed to 3.5 bits per weight for Apple Silicon Macs with 24 GB of memory, served locally through Rapid-MLX. Suits Mac users an…

Qwen3-8B-MLX-bf16

Qwen · Kit

Runs the Qwen3 8B language model through the mlx library for chat, reasoning, translation and agent work. Suits developers who want a local text model with a s…

Qwen3-30B-A3B-GGUF

Qwen · Kit

A 30.5B mixture-of-experts chat model in GGUF format with only 3.3B parameters active per token, runnable in llama.cpp or ollama. It has thinking and plain mod…

Qwen3-0.6B-GGUF

Qwen · Kit

A small 0.6B chat model in GGUF format that runs locally in llama.cpp or ollama and can switch between thinking and plain replies. Suits people with modest har…

Qwen2.5-Coder-32B-Instruct-GGUF

Qwen · Kit

GGUF copy of a 32B code chat model that runs locally with llama.cpp. It writes, explains and fixes code from plain requests, for developers who want to run it…

Qwen2.5-Coder-0.5B-Instruct

Qwen · Kit

Writes, explains and fixes code as a tiny 494M-parameter chat model with a 32,768-token context. Suits developers who want the smallest open Qwen coding model…

AstrLink Guard

QuantumNous · Kit

Finds personal information and credentials in Chinese, English and mixed text, code, logs and AI coding assistant requests, locally in ONNX. For developers who…

Raptor-0.6-4B-JANG_6M

OsaurusAI · Kit

Decides when to call a tool, when to answer directly and when to ask first, tuned from a 4B model and quantized for Apple Silicon Macs running Osaurus. For peo…

SenseNova-6.8-Code2Video GSQ-RCO GGUF

OliviaRossi · Kit

Runs a 26.9B parameter SenseNova-6.8-Code2Video model as a mixed precision GGUF file, in a terminal chat or a local server. For people who want that model on t…

RealVisXL V5.0 GGUF

off-grid-ai · Kit

Generates pictures from text on your own computer using GGUF copies of RealVisXL V5.0 with stable-diffusion.cpp. For people who want local image generation wit…

Juggernaut XL v9 GGUF

off-grid-ai · Kit

Generates pictures from text on your own computer using GGUF copies of Juggernaut XL v9 with stable-diffusion.cpp. For people who want local image generation w…

nomic-embed-text-v1.5-GGUF

nomic-ai · Kit

Turns sentences into vectors on your own machine through llama.cpp, using compact GGUF files, for search and RAG questions. For developers who want local text…

Qwen3.8-Flash-Next-DFlash2-GGUF

nazeshinjite · Kit

GGUF draft model that speeds up Qwen3.8-Flash-Next in llama.cpp through speculative decoding, in 334 MiB and 622 MiB files. It is not a standalone model, and i…

Qwen3.8-27B Fable-5 Coding Distilled GGUF

mradermacher · Kit

GGUF quantized files of a 27.3B coding-distilled Qwen3.8 model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit developers who run a cod…

VulnLLM-R-7B-8bit

mlx-community · Kit

Runs an 8-bit MLX copy of VulnLLM-R-7B for text generation through mlx-lm. Meant for developers who want to try the model locally. The card does not say what i…

Qwen3.6-35B-A3B-4bit

mlx-community · Kit

A 4-bit MLX conversion of Qwen3.6-35B-A3B that answers text and image prompts on Apple Silicon Macs. Made for people who want to run this Qwen model locally wi…

JevK5-chat-mlx-4bit

mlx-community · Kit

A 4-bit MLX copy of the 4.2B JevK5 chat model for Apple Silicon, with a 262,144 token context and a small memory footprint. Made for Mac users who want a quick…

flint-mixed-3-4bit

mlx-community · Kit

A community MLX build of Recursive's 40B Flint coding model that shrinks the experts to 3 bits, so it fits a 24 GB or 32 GB Apple Silicon Mac. Made for develop…

clef-flash-4bit

mlx-community · Kit

A 4-bit MLX copy of Cloudflare's clef-flash that turns a state and typed questions into a probability for every allowed answer on Apple Silicon Macs. Not a cha…

Muse Glimmer 30B GGUF by meta-models

meta-models · Kit

GGUF builds of a 30-billion-parameter agentic model for llama.cpp, with an optional image encoder and a speculative decoding drafter. They suit people who run…

dale-9b (GGUF)

manuelgscom · Kit

Turns a Spanish or English request into one Linux bash command, returned as a small JSON object. For terminal users and developers who want a local command hel…

askmdb-9b-GGUF

manuelgscom · Kit

Writes a read-only MongoDB aggregate pipeline from a plain Spanish or English question. A GGUF copy of a Qwen3.5-9B fine-tune that runs locally with llama.cpp,…

Maincoder-1B

Maincode · Kit

Completes and writes Python code from a function signature or a docstring. A 1B code model from Maincode that is small enough to run on consumer hardware, for…

Qwen3.8-27B-MLX-8bit

lmstudio-community · Kit

Runs a 27B model that reads images and text in an 8-bit MLX build for Apple Silicon Macs. It suits people who want picture questions answered locally.

ColGrep-Agent-2B

lightonai · Kit

A 2.5B-parameter model that finds the files and line ranges relevant to a bug report or question about a code repository, by searching and reading the repo. Ru…

Qwen3.8-27B-oQ8e-mtp

Jundot · Kit

Runs Qwen3.8-27B as an 8-bit mixed-precision MLX checkpoint with its vision encoder and MTP head, for image and text chat on Apple hardware. For people who wan…

MLX-Qwen3.5-0.8B-Claude-4.6-Opus-Reasoning-Distilled-6bit

Jackrong · Kit

Runs a tiny 0.8B reasoning-tuned chat model in the MLX format at 6-bit, converted from Jackrong's Qwen3.5 distilled model. For people who want a tiny local mod…

granite-4.2-8b GGUF

ibm-granite · Kit

Holds GGUF copies of IBM's Granite 4.2 8B model in several quantization levels, ready for llama.cpp. For people who want to run the model locally and read its…

Granite-4.2-3B (GGUF)

ibm-granite · Kit

Packages IBM's Granite 4.2 3B text model as GGUF files for local use. The 4-bit weights are estimated at about 1.8 GB, for people who want a compact model unde…

Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

hesamation · Kit

Runs a reasoning-tuned Qwen3.6-35B-A3B on your own machine as GGUF files in four quant sizes, trained on Claude Opus 4.6 style reasoning data. For people who w…

phonon-31m English for llama.cpp

gradium · Kit

Turns English text into speech from the command line or a local server, as a GGUF copy of the Phonon 31M model for llama.cpp. It suits developers who already r…

Qwen2.5-Coder-1.5B Q8_0 GGUF

ggml-org · Kit

Runs Qwen2.5-Coder 1.5B on your own machine as a Q8_0 GGUF file through llama.cpp, from the command line or as a local server. It suits developers who want a s…

embeddinggemma-2 GGUF

ggml-org · Kit

Runs a GGUF copy of Google's embeddinggemma-2, a 271M feature extraction model, with the llama command or the Llama app. For developers who want a small text e…

GLiNER2.5-multi-Decide

fastino · Kit

Classifies text into labels you pass at call time, in one pass and with no prompt template. A 287M model for routing, intent, sentiment and moderation on non-E…

Qwen3-ASR-1.7B GGUF

cstr · Kit

Turns speech, singing and songs into text, or into English, with quantized GGUF files of Qwen3-ASR-1.7B for CrispASR. For people who want local transcription a…

Underdog-Woof-4B-1.1

ConwayResearch · Kit

Generates text as a compact 4.2B model, post-trained from Qwen 3 4B to work better with Underdog's own setup and quantized to 4-bit for MLX. For people running…

SalamandraTA-7b-instruct

BSC-LT · Kit

A 7.8B translation model for 40 languages and 3 varieties, covering sentence, paragraph and document translation plus HTML or XML text. For developers and rese…

Qwen3.5-4B GGUF

bartowski · Kit

Imatrix GGUF quantizations of Qwen3.5-4B, a 4.3B image-text model with MTP layers, with the 4-bit file near 3 GB. For people who run a small model locally.

Llama-3.2-1B-Instruct GGUF

bartowski · Kit

GGUF quantizations of Llama-3.2-1B-Instruct, a 1.2B text model in eight languages, with the 4-bit file near 0.8 GB. For people who run a tiny local model.

Qwen3.8-Whittle-MoE-27B-MLX-4bit

barozp · Kit

A 4-bit MLX build for Apple Silicon of a mixture-of-experts model carved from the dense Qwen3.8-27B, with 17.8B active of 27B total parameters. For people who…

MOSS-Image-SFT GGUF

axiomofmind · Kit

Unofficial GGUF files of the MOSS-Image-SFT diffusion transformer in Q8_0 and Q4_K_S, for running text-to-image locally with stable-diffusion.cpp. Needs a sepa…

Qwen3.5-35B-A3B-GGUF

unsloth · Kit

Reads text and images, writes code and calls tools on your own machine, as Unsloth's refreshed GGUF files for the Qwen3.5 35B-A3B vision-language model. For de…

Hy-MT2-7B-GGUF

tencent · Kit

Translates text among 33 languages and follows translation instructions, as a GGUF copy of Tencent's 7B model for llama.cpp. For developers who run translation…

Hy-MT2-1.8B-GGUF

tencent · Kit

Translates text among 33 languages and obeys translation instructions, as a 1.8B model in GGUF format for llama.cpp. For developers who want a small local tran…

Qwen2.5-0.5B-Instruct

Qwen · Kit

Answers chat prompts as the smallest instruction-tuned Qwen2.5 model, at about 0.5B parameters. For developers who want a light local model for chat, structure…

GLM-5.3-Flash EXL3 3.05bpw

albucino · Kit

Runs GLM-5.3-Flash locally on two RTX 3090 cards with 128 GB of RAM and a 262,144-token context, using a verified 3.05 bpw EXL3 quantization. For people hostin…

Strata-Sage-A1.5-GGUF

ykarout · Kit

A Q4_K_M GGUF of the 35B Sage-A1.5 model made for the Strata inference engine, fitting a full 262K context on a 16 GB graphics card plus 64 GB of RAM. For peop…

Granite Speech 5.0 TurboCTC 470M GGUF

vladers · Kit

Converts speech to text in seven languages, as quantized GGUF versions of IBM's Granite Speech 5.0 TurboCTC 470M, built for transcribe.cpp. For developers addi…

Unity Coder 7B

vishnuOI · Kit

Answers Unity game development questions and writes C# scripts, XR code and editor tools, as a fine-tune of Qwen2.5-Coder-7B-Instruct. For Unity developers who…

Z-Image-Turbo-GGUF by unsloth

unsloth · Kit

Unsloth's GGUF files of Z-Image-Turbo, a fast distilled text-to-image model that the authors say fits on a 16 GB consumer GPU. For people who generate images l…

Muse Glimmer 30B GGUF

unsloth · Kit

Runs a 30B agent model locally that reads text and images, calls tools and retries failed calls, from Unsloth's GGUF files. For developers building local agent…

gemma-4-31B-it-qat-GGUF

unsloth · Kit

Runs Google's Gemma 4 31B instruction model from Unsloth's 4-bit QAT GGUF files, with an included drafter for faster speculative decoding in llama.cpp. For peo…

faster-whisper-small

Systran · Kit

Whisper small converted to the CTranslate2 format so faster-whisper can transcribe audio with it. For developers who want local speech-to-text in Python.

Flint NVFP4 GGUF

RecursiveSI · Kit

A 4-bit NVFP4 copy of the Recursive Flint text model as one GGUF file, built for NVIDIA GPUs through llama.cpp. For developers running a large local model with…

Qwen3-1.7B-GGUF

Qwen · Kit

Gives you the small Qwen3 1.7B chat model as a q8_0 GGUF file for llama.cpp, with a switch between thinking and non-thinking replies. For people who want a lig…

Xiaomi-OCR-0-GGUF

prithivMLmods · Kit

Provides GGUF files of Xiaomi-OCR-0, a compact 0.8B vision-language model for reading documents and text in images, in sizes from about 466 MB to 1.52 GB. For…

Bonsai-1.7B-GGUF

prism-ml · Kit

Generates text with a 1.7B language model packed to 1 bit per weight, about 0.24 GB, for llama.cpp on CUDA, Metal and CPU. For developers who need a tiny local…

Laguna XS 2.1

poolside · Kit

Writes code and works through long coding tasks with tool calls, using a 33B mixture-of-experts model that activates 3B parameters per token. For developers wh…

Ornith-1.0-9B-GGUF

ornith-ai · Kit

GGUF copy of a 9B open-source coding-agent model, trained with reinforcement learning to write solutions and the scaffolding around them. Built for single-GPU…

MOSS-TTS-Nano

OpenMOSS-Team · Kit

Turns text into speech with a tiny 0.1B-parameter model that can run on a CPU, supports voice cloning and covers 20 languages. It suits developers who add spee…

MiniCPM-V-4.7-1B-gguf

openbmb · Kit

Runs a 1B vision-language model through llama.cpp, answering text prompts about images. GGUF files in many quant sizes, for developers and hobbyists who want a…

Qwen3.8-27B-CodeForge-3xMerge i1 GGUF

mradermacher · Kit

Importance-matrix GGUF quants of the Qwen3.8-27B-CodeForge-3xMerge model, from about 11 GB to 22.5 GB, for local use. For people running 27B models on their ow…

Qwen3.6-35B-A3B-8bit (MLX)

mlx-community · Kit

8-bit MLX conversion of Qwen3.6-35B-A3B that reads text and images and answers in text, run with the mlx-vlm tool. For developers who want to run a large visio…

Qwen3.5-9B-OptiQ-4bit

mlx-community · Kit

A 4-bit mixed-precision MLX version of Qwen3.5-9B for local text generation on Apple Silicon, with a bundled multi-token prediction head. For Mac users who run…

Tess-4.5-27B GGUF

migtissera · Kit

GGUF builds of Tess-4.5, a 27B open-weights coding and agent model, for llama.cpp, with a vision projector and optional draft heads for faster generation. They…

GLM-5.3-Flash EXL3 3.5bpw

Mia-AiLab · Kit

Quantized copy of GLM-5.3-Flash in EXL3 format, 156 GB, with narrower routed experts, about 11 percent smaller than the same lab's 4-bit version. For people ru…

Qwen3.6-35B-A3B lododo-Distill-v1.0 (GGUF)

lododoai · Kit

Runs as a local text model, a Qwen3.6-35B-A3B fine-tune trained on data written by Qwen3.8-27B and packed as one GGUF file for llama.cpp. For people who run mo…

Slonik-27B-oQ8-mtp

kakoka · Kit

Helps write and change PostgreSQL source code with a 27B coding model, 8-bit quantized to run locally on Apple Silicon Macs through oMLX. For PostgreSQL develo…

Qwen3.8-27B-SLQ-GGUF

kaitchup · Kit

Compresses Qwen3.8-27B into three GGUF files with different size and fidelity levels, using a custom statistically lossless quantization. For people who run th…

Qwen3.8-27B-oQ6e-mtp

Jundot · Kit

A mixed-precision MLX copy of Qwen3.8-27B at about 6.9 bits per weight, with the vision encoder and multi-token prediction head included, for running locally o…

Qwen3.6-35B-A3B-oQ6e-mtp

Jundot · Kit

A mixed-precision MLX copy of Qwen3.6-35B-A3B at about 6.8 bits per weight, with the vision encoder and multi-token prediction head included, for running local…

Spark-X2.6-4B-AgentFast

JamieBradfield · Kit

Calls tools and follows instructions with almost no thinking delay, as a 4.1B fine-tune of Spark-X2.6-4B. Made for people building fast local agents that need…

Qwopus3.8-27B-Flash-V2-GGUF

Jackrong · Kit

Trims wasted reasoning in long agent tasks, as a GGUF build of the second Flash fine-tune of Qwen3.8-27B with better Python formatting. For people who run agen…

Ling-3.0-tiny-GGUF

inclusionAI · Kit

GGUF copy of inclusionAI's Ling-3.0-tiny, a small mixture-of-experts reasoning model with 7.9B total and 1.3B active parameters, for running locally at low cos…

K2-Horizon-7B-GGUF

IFM · Kit

Quantized GGUF copies of IFM's K2-Horizon-7B text model for running locally in llama.cpp, from BF16 down to 4-bit, with a 512K-token context window.

phonon-31m English for audio.cpp

gradium · Kit

Speaks English text aloud on a CPU from a 31M text-to-speech model in GGUF form, for the audio.cpp runtime. Made for developers who want a small local voice mo…

Qwen3-Reranker-0.6B-Q8_0-GGUF

ggml-org · Kit

Ranks passages by relevance to a query, as an 8-bit GGUF copy of the Qwen3 0.6B reranker made with llama.cpp. For developers who want a small local reranker fo…