AI skills and agents for developers

officialmobai_Rostam-S1-4B-GGUF

bartowski · Kit

GGUF quantizations of Rostam-S1-4B, a 4B reasoning model for math, physics, software work and Persian-English text. For people who run small models locally and…

Hemmingway-1.5 GGUF

bartowski · Kit

Imatrix GGUF quantizations of HemmingwayAI's Hemmingway-1.5, a 27B text model with MTP speculative decoding and a reasoning-effort prompt format. For people wh…

AsteroRank-Lepton-GGUF

Asteromorph · Kit

Ranks search results by relevance with a reranker for STEM and general search, shipped as GGUF files for llama.cpp. For developers and researchers who want loc…

Swift 1.5 Ornith 9B GGUF

ukisai · Kit

Runs Swift 1.5 Ornith 9B, a reasoning model tuned to think with fewer tokens, as GGUF quantizations for llama.cpp. For people who run a 9B reasoning model on t…

MN-Violet-Lotus-12B-GGUF

mradermacher · Kit

Static GGUF files of FallenMerick's MN-Violet-Lotus-12B in sizes from 4.9 GB to 13.1 GB. For people who run a 12B model on their own computer.

Ornith-1.5-9B-GGUF by AtomicChat

AtomicChat · Kit

GGUF builds of Ornith 1.5 9B, a model that reads images and text, in sizes from 2.81 GB to 17.9 GB plus a vision projector. Pick the file that fits your graphi…

Groot-19B-A3B-TTQ-GGUF

TokenTinkerer · Kit

Offers eleven GGUF sizes of the Groot-19B-A3B reasoning model for llama.cpp, from 7.88 to 18.59 GiB, plus a vision projector. Made for people who run the model…

Qwen3.5-4B-3D-Coder-GGUF

prithivMLmods · Kit

Writes code and builds interactive 3D scenes as self-contained Three.js pages, using GGUF copies of an early-preview Qwen3.5-4B fine-tune. For developers who p…

Qwen3.8-27B-DFlash2-GGUF by z-lab

z-lab · Kit

A draft model in GGUF form that speeds up Qwen3.8-27B by proposing token blocks for the main model to verify. For people who run that model locally with llama.…

SmolLM3-3B-GGUF

unsloth · Kit

Chats and reasons with SmolLM3, a fully open 3B model that can think step by step or answer directly, in GGUF files by Unsloth with chat template fixes. Handle…

Qwen3.6-27B-GGUF

unsloth · Kit

Handles agentic coding and image-plus-text tasks locally, as Unsloth's GGUF files for Qwen3.6-27B with thinking preservation and a long context. For developers…

Qwen3.5-4B-MTP-GGUF

unsloth · Kit

Unsloth's GGUF files of Qwen3.5-4B with multi-token prediction, which lets llama.cpp use speculative decoding for roughly 1.5 to 2 times faster generation. For…

Qwen3-30B-A3B-GGUF by unsloth

unsloth · Kit

GGUF files of Qwen3-30B-A3B, quantized by unsloth, for running a local chat and reasoning model in llama.cpp, Ollama or Open WebUI, with a thinking mode you ca…

Qwen3-14B-GGUF

unsloth · Kit

Gives you Qwen3 14B, a text generation model that can think through hard questions or answer fast, as GGUF files for your own computer. Packaged by unsloth for…

Qwen2.5-Coder-7B-Instruct-GGUF by unsloth

unsloth · Kit

Writes, explains and fixes code on your own computer, as Unsloth's GGUF copy of the Qwen2.5-Coder 7B instruction model. For developers who want a local coding…

Olmo-3-32B-Think-GGUF

unsloth · Kit

Gives you Olmo 3 32B Think, a 32.2B-parameter reasoning model, as GGUF files that run on your own computer. Packaged by unsloth for people who want a local mod…

Llama-3.2-3B-Instruct-GGUF by unsloth

unsloth · Kit

Chats, summarizes and answers questions with Meta's compact Llama 3.2 3B instruct model, in GGUF files by Unsloth from 2-bit up to 16-bit. Small enough for ord…

gpt-oss-120b-GGUF

unsloth · Kit

Runs OpenAI's open-weight gpt-oss-120b, a 117B model with 5.1B active parameters, from GGUF files by Unsloth that carry its fixes. Built for reasoning, agent t…

gemma-3-27b-it-GGUF

unsloth · Kit

Answers questions about text and images with Google's Gemma 3 27B instruction-tuned model, in GGUF files made by Unsloth for running on your own computer. It h…

gemma-3-270m-it-GGUF

unsloth · Kit

Generates text from prompts as a 268M instruction-tuned Gemma 3 model in GGUF format, small enough for laptops and desktops. For developers who want a tiny loc…

gemma-3-12b-it-GGUF

unsloth · Kit

Answers questions and summarizes text, and reads images, from GGUF files of Google's Gemma 3 12B instruction model. It suits people who want to run it on their…

ERNIE-4.5-21B-A3B-Thinking-GGUF

unsloth · Kit

Works through logic, math, science and coding problems with a 21B mixture-of-experts model that activates 3B parameters per token, in GGUF files by Unsloth. Su…

bge-small-en-v1.5-GGUF

unsloth · Kit

Turns English text into embeddings for search and retrieval, in a small GGUF file of 33.2M parameters. For developers who build search or retrieval apps on mod…

Clef-LoRA-for-Qwen3.8-27B-GGUF

trevest · Kit

Adds Cloudflare Clef's decision head to a Qwen3.8-27B chat model, so one llama.cpp server on a 24 GB GPU both answers typed questions and chats. It is a LoRA a…

Sweep Next-Edit 1.5B (GGUF)

sweepai · Kit

Predicts your next code edit from the open file, recent diffs and current state, running locally as a 1.5B Q8_0 GGUF model. For developers who want edit autoco…

Qwen3-TTS GGUF

Serveurperso · Kit

Speaks text in several languages with named speakers and Mandarin dialects, and can clone a voice from a short clip, through the qwentts.cpp C++ runtime on CPU…

Sarvam-105B GGUF

sarvamai · Kit

The GGUF version of Sarvam-105B, a large mixture-of-experts model with a focus on Indian languages, split into 9 shards at 4-bit for llama.cpp. For people with…

MiMo-V2.6-Distill-Qwen-9B-GSQ-RCO-GGUF

sainez · Kit

Gives you a 9B coding and tool-calling model as one 3.64 GiB GGUF file, quantized at about 3.5 bits per weight for running on your own machine.

Unlimited-OCR-2-GGUF

RX5950XT · Kit

GGUF files of the Unlimited-OCR-2 document OCR model in BF16, Q8_0 and Q4_K_M, with a vision projector. They run only in a llama.cpp build with the repository'…

Qwen3-30B-A3B-GGUF

Qwen · Kit

A 30.5B mixture-of-experts chat model in GGUF format with only 3.3B parameters active per token, runnable in llama.cpp or ollama. It has thinking and plain mod…

Qwen3-0.6B-GGUF

Qwen · Kit

A small 0.6B chat model in GGUF format that runs locally in llama.cpp or ollama and can switch between thinking and plain replies. Suits people with modest har…

Qwen2.5-Coder-32B-Instruct-GGUF

Qwen · Kit

GGUF copy of a 32B code chat model that runs locally with llama.cpp. It writes, explains and fixes code from plain requests, for developers who want to run it…

pplx-decider-flash-gguf-v1.2

perplexity-ai · Kit

Sorts a request into the choices you set, from text and images, using a Q8_0 GGUF copy of a small decision model. For developers who can run a protocol v3 runt…

Luciole-8B-Instruct-1.1-GGUF

OpenLLM-France · Kit

Quantized GGUF copy of Luciole-8B-Instruct-1.1, an 8B text generation model for French and English, for running on your own computer. From LINAGORA's work in t…

SenseNova-6.8-Code2Video GSQ-RCO GGUF

OliviaRossi · Kit

Runs a 26.9B parameter SenseNova-6.8-Code2Video model as a mixed precision GGUF file, in a terminal chat or a local server. For people who want that model on t…

RealVisXL V5.0 GGUF

off-grid-ai · Kit

Generates pictures from text on your own computer using GGUF copies of RealVisXL V5.0 with stable-diffusion.cpp. For people who want local image generation wit…

Juggernaut XL v9 GGUF

off-grid-ai · Kit

Generates pictures from text on your own computer using GGUF copies of Juggernaut XL v9 with stable-diffusion.cpp. For people who want local image generation w…

Hermes-4.3-36B-GGUF

NousResearch · Kit

A 36B hybrid reasoning model in GGUF form that can think before it answers, write valid JSON and follow your system prompt. For people who run a large model on…

nomic-embed-text-v1.5-GGUF

nomic-ai · Kit

Turns sentences into vectors on your own machine through llama.cpp, using compact GGUF files, for search and RAG questions. For developers who want local text…

Qwen3.8-Flash-Next-DFlash2-GGUF

nazeshinjite · Kit

GGUF draft model that speeds up Qwen3.8-Flash-Next in llama.cpp through speculative decoding, in 334 MiB and 622 MiB files. It is not a standalone model, and i…

Qwen3.8-27B Fable-5 Coding Distilled GGUF

mradermacher · Kit

GGUF quantized files of a 27.3B coding-distilled Qwen3.8 model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit developers who run a cod…

OneJev1.6-4B-GGUF

mradermacher · Kit

Quantized GGUF copies of OneJev1.6-4B, from about 2 GB to 8.5 GB, for running the model on your own computer. The card does not say what the base model is for.

L3-8B-Stheno-v3.3-32K-GGUF

mradermacher · Kit

Static GGUF files of Sao10K's Stheno 8B model in sizes from 3.3 GB to 16.2 GB. For people who run an 8B model on their own computer, under a non-commercial lic…

KnowLine-4B-Gen5.5-GGUF

mradermacher · Kit

Static GGUF files of PelaAI's KnowLine 4B model in sizes from 2.1 GB to 8.8 GB, with English and Chinese listed. For people who run a small model on their own…

Muse Glimmer 30B GGUF by meta-models

meta-models · Kit

GGUF builds of a 30-billion-parameter agentic model for llama.cpp, with an optional image encoder and a speculative decoding drafter. They suit people who run…

dale-9b (GGUF)

manuelgscom · Kit

Turns a Spanish or English request into one Linux bash command, returned as a small JSON object. For terminal users and developers who want a local command hel…

askmdb-9b-GGUF

manuelgscom · Kit

Writes a read-only MongoDB aggregate pipeline from a plain Spanish or English question. A GGUF copy of a Qwen3.5-9B fine-tune that runs locally with llama.cpp,…

Qwopus3.8-27B-Flash-GGUF

Jackrong · Kit

Cuts reasoning time and cost for long agent tasks, as a GGUF build of a Qwen3.8-27B fine-tune. Made for people who run agent loops on their own machine and wan…

Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Jackrong · Kit

Thinks through problems step by step inside think tags, as a 4B Qwen3.5 model fine-tuned on reasoning chains and packaged as GGUF. For people who run a small r…

Qwen3.8-Flash-Coder APEX-I-MiniPlus V2.1 GGUF

IsValorum · Kit

An English-only coding model in GGUF, a 42.6B mixture-of-experts quant of about 21.8 GB, for code completion, refactoring and agentic tool calls in llama.cpp o…

K2-Horizon-3.7B-GGUF

IFM · Kit

GGUF files of the 3.7B K2-Horizon text model in six precision levels, from BF16 to Q4_K_M, for running with llama.cpp. The model has a 512K-token context windo…

granite-4.2-8b GGUF

ibm-granite · Kit

Holds GGUF copies of IBM's Granite 4.2 8B model in several quantization levels, ready for llama.cpp. For people who want to run the model locally and read its…

Granite-4.2-3B (GGUF)

ibm-granite · Kit

Packages IBM's Granite 4.2 3B text model as GGUF files for local use. The 4-bit weights are estimated at about 1.8 GB, for people who want a compact model unde…

Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

hesamation · Kit

Runs a reasoning-tuned Qwen3.6-35B-A3B on your own machine as GGUF files in four quant sizes, trained on Claude Opus 4.6 style reasoning data. For people who w…

phonon-31m English for llama.cpp

gradium · Kit

Turns English text into speech from the command line or a local server, as a GGUF copy of the Phonon 31M model for llama.cpp. It suits developers who already r…

gemma-4-31B-it-qat-q4_0-gguf

google · Kit

Runs Google's Gemma 4 31B instruction-tuned model as a 4-bit GGUF file that reads text and images and answers in text. It suits developers and enthusiasts with…

Qwen2.5-Coder-1.5B Q8_0 GGUF

ggml-org · Kit

Runs Qwen2.5-Coder 1.5B on your own machine as a Q8_0 GGUF file through llama.cpp, from the command line or as a local server. It suits developers who want a s…

embeddinggemma-2 GGUF

ggml-org · Kit

Runs a GGUF copy of Google's embeddinggemma-2, a 271M feature extraction model, with the llama command or the Llama app. For developers who want a small text e…

Clef-GGUF

ggml-org · Kit

GGUF files of Cloudflare's Clef decision model, which takes image and text input. Served with llama.cpp tools and called through a decision API path. For devel…

Kvark-Sparkle-1.0-27B

Egzakta · Kit

Reasons over images and text with fewer thinking tokens than its base Qwen3.8-27B, so answers arrive in about half the time at similar accuracy, per its card.…

Qwen3-ASR-1.7B GGUF

cstr · Kit

Turns speech, singing and songs into text, or into English, with quantized GGUF files of Qwen3-ASR-1.7B for CrispASR. For people who want local transcription a…

Qwen 3.6 35B-A3B REAP-48 v2 GGUF

crucible-labs · Kit

Runs a pruned and quantized Qwen3.6-35B-A3B in an 8.78 GiB GGUF file for llama.cpp, closer to the unquantized weights than the first release. For people with l…

t5-v1_1-xxl-encoder-gguf

city96 · Kit

A GGUF conversion of Google's T5 v1.1 XXL text encoder, for turning text into embeddings in llama.cpp or feeding image generation models through ComfyUI-GGUF.…

pig-vae

calcuis · Kit

A small GGUF VAE in the pig architecture for image and video workflows, with a loader in the gguf-node package. Aimed at faster runs and lower memory use on ol…

Qwen3.5-9B GGUF (ShapeLearn)

byteshape · Kit

GGUF copies of Qwen3.5-9B, a model that reads text and images, compressed with ByteShape's ShapeLearn for llama.cpp. Variants for GPUs and CPUs, from about 3 G…

North-Mini-Code-1.0 GGUF

byteshape · Kit

GGUF copies of the North-Mini-Code-1.0 coding model, compressed with ByteShape's ShapeLearn for GPU use in llama.cpp. Four sizes from 12.1 GB to 21.5 GB, for d…

Qwen3.5-4B GGUF

bartowski · Kit

Imatrix GGUF quantizations of Qwen3.5-4B, a 4.3B image-text model with MTP layers, with the 4-bit file near 3 GB. For people who run a small model locally.

MiniCPM5-2B-GGUF by bartowski

bartowski · Kit

Quantized GGUF copies of the MiniCPM5-2B text model in many sizes, made with llama.cpp and an importance matrix. For people running a small English and Chinese…

Llama-3.2-1B-Instruct GGUF

bartowski · Kit

GGUF quantizations of Llama-3.2-1B-Instruct, a 1.2B text model in eight languages, with the 4-bit file near 0.8 GB. For people who run a tiny local model.

granite-4.2-3b-GGUF

bartowski · Kit

Quantized GGUF copies of IBM's granite-4.2-3b text model, in many sizes from full precision down to small 3-bit files. For people who run a small chat model on…

google_gemma-4-31B-it-GGUF

bartowski · Kit

Quantized GGUF files of Google's Gemma 4 31B instruction model, from 17.15 GB to 61.41 GB, made by bartowski with an importance matrix. Reads images and text.…

Cloudflare clef GGUF

bartowski · Kit

Static GGUF quantizations of Cloudflare's clef decision model, which scores every answer option to typed questions about a state in one pass instead of writing…

MOSS-Image-SFT GGUF

axiomofmind · Kit

Unofficial GGUF files of the MOSS-Image-SFT diffusion transformer in Q8_0 and Q4_K_S, for running text-to-image locally with stable-diffusion.cpp. Needs a sepa…

Ming 3.0 TTS 0.5B GGUF

audio-cpp · Kit

GGUF packages of Ming 3.0 TTS 0.5B for the audio.cpp runtime: speech from text, voice cloning and voice design in seven languages, with mono 44.1 kHz output an…

Qwen3.5-35B-A3B-GGUF

unsloth · Kit

Reads text and images, writes code and calls tools on your own machine, as Unsloth's refreshed GGUF files for the Qwen3.5 35B-A3B vision-language model. For de…

Hy-MT2-7B-GGUF

tencent · Kit

Translates text among 33 languages and follows translation instructions, as a GGUF copy of Tencent's 7B model for llama.cpp. For developers who run translation…

Hy-MT2-1.8B-GGUF

tencent · Kit

Translates text among 33 languages and obeys translation instructions, as a 1.8B model in GGUF format for llama.cpp. For developers who want a small local tran…

BaronLLM Offensive Security LLM Q6_K GGUF

AlicanKiraz0 · Kit

Answers security questions and helps plan authorized red-team exercises, as a Q6_K GGUF fine-tune of Llama 3.1 8B. For security researchers working on systems…

Qwen3.8-27B Agention Precision GGUF

agentionai · Kit

Packs Qwen3.8-27B as llama.cpp GGUF files in eight sizes from 8.95 to 16.35 GiB, plus a vision projector. The author reports less drift from the BF16 model tha…

Occamy-1.0

Accio-Lab · Kit

An open 35B image and text model from Accio-Lab, based on Qwen3.6-35B-A3B, in BF16, GGUF, FP8, NVFP4 and MLX formats. For teams that serve a large model.

Qwen3.8-Flash-Next-125B-UltraLite-37GiB-GGUF

0xKitkat · Kit

Squeezes the Qwen3.8-Flash-Next mixture-of-experts model into about 37 GiB of text-only GGUF files for experiments. It needs a patched llama.cpp build that com…

Strata-Sage-A1.5-GGUF

ykarout · Kit

A Q4_K_M GGUF of the 35B Sage-A1.5 model made for the Strata inference engine, fitting a full 262K context on a 16 GB graphics card plus 64 GB of RAM. For peop…

OpenBonsai Qwen3.5-9B Ternary

webbrain-one · Kit

Runs Qwen3.5-9B squeezed to ternary weights in a roughly 2 GB GGUF file, for CPU use in two llama.cpp variants. A research preview for people who experiment wi…

Granite Speech 5.0 TurboCTC 470M GGUF

vladers · Kit

Converts speech to text in seven languages, as quantized GGUF versions of IBM's Granite Speech 5.0 TurboCTC 470M, built for transcribe.cpp. For developers addi…

Z-Image-Turbo-GGUF by unsloth

unsloth · Kit

Unsloth's GGUF files of Z-Image-Turbo, a fast distilled text-to-image model that the authors say fits on a 16 GB consumer GPU. For people who generate images l…

Qwen3.6-27B-MTP-GGUF

unsloth · Kit

Codes and reasons with Qwen3.6 27B in GGUF files by Unsloth that carry multi-token prediction, which the card says speeds up replies about 1.5 to 2 times with…

Qwen3.5-0.8B-MTP-GGUF

unsloth · Kit

Runs the small Qwen3.5 0.8B vision-language model in llama.cpp with multi-token prediction for faster generation, as Unsloth's GGUF files. For developers testi…

Muse Glimmer 30B GGUF

unsloth · Kit

Runs a 30B agent model locally that reads text and images, calls tools and retries failed calls, from Unsloth's GGUF files. For developers building local agent…

granite-4.1-8b-GGUF

unsloth · Kit

Follows instructions, calls tools and chats with IBM's Granite 4.1 8B model, in GGUF files by Unsloth that include chat template fixes. Made for business assis…

gemma-4-31B-it-qat-GGUF

unsloth · Kit

Runs Google's Gemma 4 31B instruction model from Unsloth's 4-bit QAT GGUF files, with an included drafter for faster speculative decoding in llama.cpp. For peo…

YuE2-GGUF

Serveurperso · Kit

Pre-quantized GGUF files for yue2.cpp, a C++ song generator that turns style tags and lyrics into stereo audio plus the score it composed. For musicians and ti…

Haas-ja-v1.0-GGUF

sakasegawa · Kit

GGUF files of a Japanese speech recognition model that run only in speech.cpp, on macOS, Windows, Linux or the CPU alone. For people who transcribe Japanese au…

Flint NVFP4 GGUF

RecursiveSI · Kit

A 4-bit NVFP4 copy of the Recursive Flint text model as one GGUF file, built for NVIDIA GPUs through llama.cpp. For developers running a large local model with…

Qwen3-Embedding-0.6B-GGUF

Qwen · Kit

Turns text into number vectors for search, retrieval and clustering in more than 100 languages, as a 0.6B model in GGUF format. Suits developers building searc…

Qwen3-1.7B-GGUF

Qwen · Kit

Gives you the small Qwen3 1.7B chat model as a q8_0 GGUF file for llama.cpp, with a switch between thinking and non-thinking replies. For people who want a lig…

Xiaomi-OCR-0-GGUF

prithivMLmods · Kit

Provides GGUF files of Xiaomi-OCR-0, a compact 0.8B vision-language model for reading documents and text in images, in sizes from about 466 MB to 1.52 GB. For…

Bonsai-1.7B-GGUF

prism-ml · Kit

Generates text with a 1.7B language model packed to 1 bit per weight, about 0.24 GB, for llama.cpp on CUDA, Metal and CPU. For developers who need a tiny local…

Qwen3.8-27B-QSA-GSQ-RCO-GGUF

pentacoxian-dev · Kit

Runs Qwen3.8-27B with sparse attention on a single 24 GB GPU at a 262K-token context with image input, as GGUF files for people with a custom llama.cpp engine…

Ornith-1.0-9B-GGUF

ornith-ai · Kit

GGUF copy of a 9B open-source coding-agent model, trained with reinforcement learning to write solutions and the scaffolding around them. Built for single-GPU…

MiniCPM-V-4.7-1B-gguf

openbmb · Kit

Runs a 1B vision-language model through llama.cpp, answering text prompts about images. GGUF files in many quant sizes, for developers and hobbyists who want a…