AI skills and agents for developers

Swift 1.5 Ornith 9B GGUF

ukisai · Kit

Runs Swift 1.5 Ornith 9B, a reasoning model tuned to think with fewer tokens, as GGUF quantizations for llama.cpp. For people who run a 9B reasoning model on t…

Groot-19B-A3B-TTQ-GGUF

TokenTinkerer · Kit

Offers eleven GGUF sizes of the Groot-19B-A3B reasoning model for llama.cpp, from 7.88 to 18.59 GiB, plus a vision projector. Made for people who run the model…

Qwen3.8-27B-DFlash2-GGUF by z-lab

z-lab · Kit

A draft model in GGUF form that speeds up Qwen3.8-27B by proposing token blocks for the main model to verify. For people who run that model locally with llama.…

Qwen3.5-4B-MTP-GGUF

unsloth · Kit

Unsloth's GGUF files of Qwen3.5-4B with multi-token prediction, which lets llama.cpp use speculative decoding for roughly 1.5 to 2 times faster generation. For…

Qwen3-30B-A3B-GGUF by unsloth

unsloth · Kit

GGUF files of Qwen3-30B-A3B, quantized by unsloth, for running a local chat and reasoning model in llama.cpp, Ollama or Open WebUI, with a thinking mode you ca…

Clef-LoRA-for-Qwen3.8-27B-GGUF

trevest · Kit

Adds Cloudflare Clef's decision head to a Qwen3.8-27B chat model, so one llama.cpp server on a 24 GB GPU both answers typed questions and chats. It is a LoRA a…

Sarvam-105B GGUF

sarvamai · Kit

The GGUF version of Sarvam-105B, a large mixture-of-experts model with a focus on Indian languages, split into 9 shards at 4-bit for llama.cpp. For people with…

Unlimited-OCR-2-GGUF

RX5950XT · Kit

GGUF files of the Unlimited-OCR-2 document OCR model in BF16, Q8_0 and Q4_K_M, with a vision projector. They run only in a llama.cpp build with the repository'…

Qwen3-30B-A3B-GGUF

Qwen · Kit

A 30.5B mixture-of-experts chat model in GGUF format with only 3.3B parameters active per token, runnable in llama.cpp or ollama. It has thinking and plain mod…

Qwen3-0.6B-GGUF

Qwen · Kit

A small 0.6B chat model in GGUF format that runs locally in llama.cpp or ollama and can switch between thinking and plain replies. Suits people with modest har…

Qwen2.5-Coder-32B-Instruct-GGUF

Qwen · Kit

GGUF copy of a 32B code chat model that runs locally with llama.cpp. It writes, explains and fixes code from plain requests, for developers who want to run it…

nomic-embed-text-v1.5-GGUF

nomic-ai · Kit

Turns sentences into vectors on your own machine through llama.cpp, using compact GGUF files, for search and RAG questions. For developers who want local text…

Qwen3.8-Flash-Next-DFlash2-GGUF

nazeshinjite · Kit

GGUF draft model that speeds up Qwen3.8-Flash-Next in llama.cpp through speculative decoding, in 334 MiB and 622 MiB files. It is not a standalone model, and i…

Muse Glimmer 30B GGUF by meta-models

meta-models · Kit

GGUF builds of a 30-billion-parameter agentic model for llama.cpp, with an optional image encoder and a speculative decoding drafter. They suit people who run…

askmdb-9b-GGUF

manuelgscom · Kit

Writes a read-only MongoDB aggregate pipeline from a plain Spanish or English question. A GGUF copy of a Qwen3.5-9B fine-tune that runs locally with llama.cpp,…

Qwen3.8-Flash-Coder APEX-I-MiniPlus V2.1 GGUF

IsValorum · Kit

An English-only coding model in GGUF, a 42.6B mixture-of-experts quant of about 21.8 GB, for code completion, refactoring and agentic tool calls in llama.cpp o…

K2-Horizon-3.7B-GGUF

IFM · Kit

GGUF files of the 3.7B K2-Horizon text model in six precision levels, from BF16 to Q4_K_M, for running with llama.cpp. The model has a 512K-token context windo…

granite-4.2-8b GGUF

ibm-granite · Kit

Holds GGUF copies of IBM's Granite 4.2 8B model in several quantization levels, ready for llama.cpp. For people who want to run the model locally and read its…

phonon-31m English for llama.cpp

gradium · Kit

Turns English text into speech from the command line or a local server, as a GGUF copy of the Phonon 31M model for llama.cpp. It suits developers who already r…

Qwen2.5-Coder-1.5B Q8_0 GGUF

ggml-org · Kit

Runs Qwen2.5-Coder 1.5B on your own machine as a Q8_0 GGUF file through llama.cpp, from the command line or as a local server. It suits developers who want a s…

Clef-GGUF

ggml-org · Kit

GGUF files of Cloudflare's Clef decision model, which takes image and text input. Served with llama.cpp tools and called through a decision API path. For devel…

theOG-50M

DrunkkToys · Kit

Writes a Python function from a plain English request. A 50M parameter code model trained from scratch on one laptop, small enough to run offline in Ollama, LM…

Qwen 3.6 35B-A3B REAP-48 v2 GGUF

crucible-labs · Kit

Runs a pruned and quantized Qwen3.6-35B-A3B in an 8.78 GiB GGUF file for llama.cpp, closer to the unquantized weights than the first release. For people with l…

t5-v1_1-xxl-encoder-gguf

city96 · Kit

A GGUF conversion of Google's T5 v1.1 XXL text encoder, for turning text into embeddings in llama.cpp or feeding image generation models through ComfyUI-GGUF.…

Qwen3.5-9B GGUF (ShapeLearn)

byteshape · Kit

GGUF copies of Qwen3.5-9B, a model that reads text and images, compressed with ByteShape's ShapeLearn for llama.cpp. Variants for GPUs and CPUs, from about 3 G…

North-Mini-Code-1.0 GGUF

byteshape · Kit

GGUF copies of the North-Mini-Code-1.0 coding model, compressed with ByteShape's ShapeLearn for GPU use in llama.cpp. Four sizes from 12.1 GB to 21.5 GB, for d…

MiniCPM5-2B-GGUF by bartowski

bartowski · Kit

Quantized GGUF copies of the MiniCPM5-2B text model in many sizes, made with llama.cpp and an importance matrix. For people running a small English and Chinese…

google_gemma-4-31B-it-GGUF

bartowski · Kit

Quantized GGUF files of Google's Gemma 4 31B instruction model, from 17.15 GB to 61.41 GB, made by bartowski with an importance matrix. Reads images and text.…

Cloudflare clef GGUF

bartowski · Kit

Static GGUF quantizations of Cloudflare's clef decision model, which scores every answer option to typed questions about a state in one pass instead of writing…

Hy-MT2-7B-GGUF

tencent · Kit

Translates text among 33 languages and follows translation instructions, as a GGUF copy of Tencent's 7B model for llama.cpp. For developers who run translation…

Hy-MT2-1.8B-GGUF

tencent · Kit

Translates text among 33 languages and obeys translation instructions, as a 1.8B model in GGUF format for llama.cpp. For developers who want a small local tran…

Qwen3.8-27B Agention Precision GGUF

agentionai · Kit

Packs Qwen3.8-27B as llama.cpp GGUF files in eight sizes from 8.95 to 16.35 GiB, plus a vision projector. The author reports less drift from the BF16 model tha…

Qwen3.8-Flash-Next-125B-UltraLite-37GiB-GGUF

0xKitkat · Kit

Squeezes the Qwen3.8-Flash-Next mixture-of-experts model into about 37 GiB of text-only GGUF files for experiments. It needs a patched llama.cpp build that com…

OpenBonsai Qwen3.5-9B Ternary

webbrain-one · Kit

Runs Qwen3.5-9B squeezed to ternary weights in a roughly 2 GB GGUF file, for CPU use in two llama.cpp variants. A research preview for people who experiment wi…

Qwen3.5-0.8B-MTP-GGUF

unsloth · Kit

Runs the small Qwen3.5 0.8B vision-language model in llama.cpp with multi-token prediction for faster generation, as Unsloth's GGUF files. For developers testi…

gemma-4-31B-it-qat-GGUF

unsloth · Kit

Runs Google's Gemma 4 31B instruction model from Unsloth's 4-bit QAT GGUF files, with an included drafter for faster speculative decoding in llama.cpp. For peo…

Flint NVFP4 GGUF

RecursiveSI · Kit

A 4-bit NVFP4 copy of the Recursive Flint text model as one GGUF file, built for NVIDIA GPUs through llama.cpp. For developers running a large local model with…

Qwen3-1.7B-GGUF

Qwen · Kit

Gives you the small Qwen3 1.7B chat model as a q8_0 GGUF file for llama.cpp, with a switch between thinking and non-thinking replies. For people who want a lig…

Xiaomi-OCR-0-GGUF

prithivMLmods · Kit

Provides GGUF files of Xiaomi-OCR-0, a compact 0.8B vision-language model for reading documents and text in images, in sizes from about 466 MB to 1.52 GB. For…

Bonsai-1.7B-GGUF

prism-ml · Kit

Generates text with a 1.7B language model packed to 1 bit per weight, about 0.24 GB, for llama.cpp on CUDA, Metal and CPU. For developers who need a tiny local…

Qwen3.8-27B-QSA-GSQ-RCO-GGUF

pentacoxian-dev · Kit

Runs Qwen3.8-27B with sparse attention on a single 24 GB GPU at a 262K-token context with image input, as GGUF files for people with a custom llama.cpp engine…

MiniCPM-V-4.7-1B-gguf

openbmb · Kit

Runs a 1B vision-language model through llama.cpp, answering text prompts about images. GGUF files in many quant sizes, for developers and hobbyists who want a…

MiniCPM-OCR Jev GGUF

openbmb · Kit

Scores OCR readings of text, formula and table regions with a quality value between 0 and 1, in GGUF files for llama.cpp. For people who check OCR results on t…

Qwen3.5-0.8B-weight-space-programming-GGUF by NotCherry

NotCherry · Kit

Packages the Qwen3.5-0.8B weight-space-programming model as GGUF files for llama.cpp, with a 4-bit text model and a separate vision projector for image input.

Tess-4.5-27B GGUF

migtissera · Kit

GGUF builds of Tess-4.5, a 27B open-weights coding and agent model, for llama.cpp, with a vision projector and optional draft heads for faster generation. They…

Qwen3.6-35B-A3B lododo-Distill-v1.0 (GGUF)

lododoai · Kit

Runs as a local text model, a Qwen3.6-35B-A3B fine-tune trained on data written by Qwen3.8-27B and packed as one GGUF file for llama.cpp. For people who run mo…

Qwen3.8-27B-SLQ-GGUF

kaitchup · Kit

Compresses Qwen3.8-27B into three GGUF files with different size and fidelity levels, using a custom statistically lossless quantization. For people who run th…

K2-Horizon-7B-GGUF

IFM · Kit

Quantized GGUF copies of IFM's K2-Horizon-7B text model for running locally in llama.cpp, from BF16 down to 4-bit, with a 512K-token context window.

Qwen3.8-27B Intel Arc Tuned

Greatjedi · Kit

Runs a 27B Qwen3.8 model in GGUF files retuned for Intel Arc GPUs, with pure decode near 22 tokens a second in the author's tests. For people running llama.cpp…

Qwen3-Reranker-0.6B-Q8_0-GGUF

ggml-org · Kit

Ranks passages by relevance to a query, as an 8-bit GGUF copy of the Qwen3 0.6B reranker made with llama.cpp. For developers who want a small local reranker fo…

Laya-GGUF

ggml-org · Kit

Small 421M-parameter decision model in GGUF form that you serve locally and call through a systemone API. For developers who use llama.cpp tooling and want a c…

DeepSeek-V4.1-Flash-1017 GGUF

ggml-org · Kit

GGUF files of DeepSeek's 748B V4.1 Flash 1017 model, converted by ggml-org with a vision file for images, for people with big-memory machines who run models th…

POCKET-35B-GGUF

FINAL-Bench · Kit

Runs a Korean-tuned 35B model on your own PC from GGUF files with llama.cpp, with a CPU-only path so no GPU is needed. For people who want a local language mod…

KVARK Sparkle 1.1 27B GGUF

Egzakta · Kit

Runs the 27B KVARK Sparkle 1.1 model from GGUF files in several sizes, with optional image input and speculative decoding. For people running models locally wi…

Kvark-Sparkle-1.0-27B-GGUF

Egzakta · Kit

GGUF files of KVARK Sparkle 1.0, a 27B vision-language model, for llama.cpp, Ollama and LM Studio, with the speculative-decoding head kept. For people running…

Qwen3.8-27B iMatrix NVFP4 MTP GGUF

cdiamond · Kit

A 17.1 GB mixed-precision GGUF of Qwen3.8-27B that keeps its multi-token prediction layer, tuned for 256K context with vision on a 24 GB GPU. For people who ru…

Qwen3.6-35B-A3B MTP GGUF

byteshape · Kit

Runs Qwen3.6-35B-A3B from a GGUF quantization with Multi-Token Prediction for faster GPU decoding in llama.cpp. Made by ByteShape for people running local mode…

Llama-3.2-3B-Instruct-GGUF

bartowski · Kit

GGUF quantizations of Meta's Llama-3.2-3B-Instruct, made by bartowski with an importance matrix, from about 1.8 GB to 6.4 GB. For running a small chat model lo…

Spark-X2.6-1.7B-DSpark-GGUF

XHToken · Kit

A small draft model that speeds up Spark-X2.6-1.7B through speculative decoding, guessing up to seven tokens per step. For people who run that model locally on…

Qwen3-4B-GGUF

Qwen · Kit

A 4B chat model in GGUF format that runs locally in llama.cpp or ollama, with a thinking mode for reasoning and a plain mode for quick replies. Suits developer…

Qwen2.5-Coder-14B-Instruct-GGUF

Qwen · Kit

Gives you the Qwen2.5-Coder 14B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp. For developers who want a stronger lo…

Qwen2.5-Coder-1.5B-Instruct-GGUF

Qwen · Kit

Gives you the small Qwen2.5-Coder 1.5B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp on a laptop. For developers who…

Rein-NPC-4B

jmc0 · Kit

Drives game characters that hold a conversation, take in-game actions such as selling an item or calling guards, and stay in character under pressure. For game…

Mellum2.1-12B-A2.5B-Thinking-GGUF

JetBrains · Kit

Runs JetBrains' 12B reasoning model locally in llama.cpp, Ollama or LM Studio, with five GGUF sizes to pick from. For developers who want a thinking model with…

Axion-1.0-35B-APEX-I-MiniPlus-V2.1-GGUF

IsValorum · Kit

Runs the 35B Axion-1.0 model locally in llama.cpp from one compressed GGUF file with mixed precision. A quantized release by IsValorum for people who want a la…

Qwen3.8-27B-Ridge-GGUF

empero-ai · Kit

Runs Qwen3.8-27B as a compact 3.7 bits-per-weight GGUF file that suits a 16 GB GPU, with optional image input. For people running models locally with llama.cpp…

Qwen3.6-35B-A3B 2-bit GSQ GGUF

chtisgit · Kit

Runs a 35B Qwen model in a 2-bit GSQ GGUF conversion with a separate vision projector for llama.cpp. For people who want a large model in a small file on CPU o…

Qwen3.6-35B-A3B GGUF (ShapeLearn Quantized)

byteshape · Kit

Quantized GGUF versions of Qwen3.6-35B-A3B that read images and text, with CPU and GPU variants from about 9 GB, made with ByteShape's ShapeLearn. For develope…

Spark-X2.6-4B GGUF

bartowski · Kit

Small English and Chinese chat model as GGUF files from full bf16 down to about 2.4 GB, for llama.cpp, with a low or high thinking setting. For developers who…

Qwen3.6-35B-A3B-coding-reap50-GGUF

anik-jha · Kit

Writes code with Qwen3.6-35B-A3B cut to half its experts and packed as GGUF files for llama.cpp. Made for developers who want a coding model that fits in less…

Spark-X2.6-4B-DSpark-GGUF

XHToken · Kit

Speeds up text generation for Spark-X2.6-4B as a small draft model for speculative decoding, in GGUF format. Meant for people running that model locally with l…

Nanbeige4.3-33B-GGUF-UltraOptimised-Curated-Protium

SolsticeAI · Kit

Offers GGUF quantizations of the 33.1B Nanbeige4.3 model for llama.cpp and Ollama, with a reasoning protocol and up to 524,288 tokens of context. For developer…

Qwen2.5-1.5B-Instruct-GGUF

Qwen · Kit

Gives you the small Qwen2.5 1.5B chat model as GGUF files in eight quantization sizes, for running with llama.cpp on a laptop or modest GPU. For people who wan…

Ornith-1.5-35B-A3B-GSQ-RCO-GGUF

pfeifferj · Kit

Shrinks the Ornith-1.5-35B-A3B text model to 3-bit and 3.5-bit GGUF files, about 13 and 15 GB instead of 69 GB, for people who run local models with llama.cpp.

ttf-Qwen3.8-Flash-Next-GGUF

oguzeldereli · Kit

Runs Qwen3.8-Flash-Next, a 180B mixture-of-experts model squeezed to ternary weights, from one 40.4 GB GGUF file that is 4.6 times smaller than the FP8 release…

Hermes-3-Llama-3.1-8B-GGUF

NousResearch · Kit

Runs Hermes 3, an 8B general-purpose chat model from NousResearch, as a quantized GGUF file for llama.cpp. Suits people who want a local assistant with functio…

Qwen3.8-27B-GGUF by bartowski

bartowski · Kit

A set of GGUF quantizations of Qwen3.8-27B by bartowski, from Q8_0 down to 3-bit, made with an importance matrix. For people running a 27B vision-language mode…

Jackrong_Qwopus3.8-27B-Coder-Flash-GGUF

bartowski · Kit

GGUF quantizations of Jackrong's Qwopus3.8-27B-Coder-Flash, made by bartowski with an importance matrix, in sizes from 17 GB to 55 GB. For running a 27B model…

Qwen3.5-9B-MTP-GGUF

unsloth · Kit

GGUF copies of Qwen3.5 9B that support multi-token-prediction speculative decoding in llama.cpp for faster generation. For people running the model locally who…

Bonsai-27B-gguf

prism-ml · Kit

Runs a 27B-class reasoning model as a 1-bit GGUF file of about 3.9 GB for llama.cpp, so it fits a laptop or one GPU. For people who want local reasoning on eve…

Qwen3.8-27B-GGUF by lmstudio-community

lmstudio-community · Kit

A GGUF quantization of Qwen's Qwen3.8-27B made by the LM Studio team with llama.cpp, for people who run a 27B model on their own computer.

Raon-1 mini (GGUF)

KRAFTON · Kit

Runs a 28.8B mixture-of-experts model tuned for Korean chat, reasoning and tool-using agents in llama.cpp. GGUF copy of Raon-1 mini preview for people who run…

Qwen3.8-2B-Distill-GGUF

empero-ai · Kit

Runs a small 2B reasoning model on phones, laptops and single-board computers, as GGUF files in five quant levels. A distillation of a large Qwen3.8 model, pac…

Nanbeige_Nanbeige4.3-33B-GGUF

bartowski · Kit

GGUF quantizations of Nanbeige4.3-33B, made by bartowski with an importance matrix, from about 21 GB to 66 GB. For running a 33B English and Chinese text model…

Qwen3.5-0.8B Astra Weight Edit

JonathanColetti · Kit

Fixes the repeat loops that Qwen3.5-0.8B falls into in thinking mode by editing two weight tensors directly, with no training. A small image-text model for Tra…

Qwen3.8-4B-Distill-GGUF

empero-ai · Kit

Runs a 4B reasoning model on a laptop or a mid-range graphics card, as GGUF files in five quant levels. A distillation of a large Qwen3.8 model, packaged by Em…

gemma-4-12B-it-qat-GGUF

unsloth · Kit

Gemma 4 12B in GGUF form, trained with quantization-aware training so a 4-bit copy keeps near-bfloat16 quality. For people running Gemma locally with llama.cpp…

Qwen3-8B-GGUF

Qwen · Kit

Runs Qwen3-8B as quantized GGUF files in llama.cpp or Ollama, with a thinking mode for math, code and logic and a plain mode for chat. For people who want a lo…

Qwen3.8-9B-Distill-GGUF

empero-ai · Kit

GGUF quantizations of Empero's Qwen3.8-9B, a reasoning model distilled from a larger Qwen3.8 into the Qwen3.5-9B design, for llama.cpp, Ollama, LM Studio and s…

ZONOS3-Mini GGUF

AtomicChat · Kit

Packs the ZONOS3-Mini text-to-speech model as GGUF files for llama.cpp, with 27 built-in voices and six backbone sizes from 0.41 to 1.61 GB. For developers run…

Qwen3.8-35B-A3B-Distill-GGUF

empero-ai · Kit

Runs a 35B Mixture-of-Experts model with about 3B active parameters per token from GGUF files in ten sizes, plus a vision projector. For llama.cpp, Ollama, LM…

Qwen3.6-35B-A3B-MTP-GGUF

unsloth · Kit

Runs Qwen3.6-35B-A3B locally from Unsloth's GGUF files with multi-token prediction for faster decoding in llama.cpp. Suits developers who want a local agentic…

Qwen2.5-Coder-7B-Instruct-GGUF

Qwen · Kit

Runs a 7B instruction-tuned coding model from Qwen on your own machine, packed as GGUF files in eight quantization levels. Made for developers who want code he…

Thinklite-27B-GGUF

Sparset · Kit

A 4-bit GGUF copy of Thinklite-27B for llama.cpp that uses less reasoning per answer than its base model, for people running a 27B text model locally.

S5-nano-GGUF

maritaca-ai · Kit

Runs Maritaca AI's S5-nano, a 4B model tuned for Brazilian Portuguese with function calling and a think mode, from GGUF files of 2.8 to 8.7 GB for llama.cpp an…

MNN-Pocket-0.3B-GGUF

taobao-mnn · Kit

Runs a compact 0.3B Chinese and English language model from GGUF files of 192 to 726 MB, made for phones, laptops and other on-device use with llama.cpp, LM St…

BotPsy-0.8B-GGUFs

qvac · Kit

GGUF copies of the 0.8B BotPsy tool-calling model in BF16, Q8_0 and Q4_K_M, for running agent and function-calling work fully on your own device with llama.cpp.

Raon-1 nano (GGUF)

KRAFTON · Kit

Packages the Raon-1 nano language model as GGUF files for llama.cpp, so developers can run a Korean and English chat model on their own computer. Four quant ty…

Ripple-65B-Preview-GGUF

AtomicChat · Kit

GGUF quantized files of the 65B Ripple Preview agentic-coding model, for running locally with llama.cpp. For people who run large open models on their own hard…

Qwen3.8-27B GGUF (ShapeLearn Quantized)

byteshape · Kit

Runs Qwen3.8-27B as GGUF files quantized by ByteShape's ShapeLearn, in five GPU-sized options with vision input and MTP speculative decoding in llama.cpp. For…