Kits of AI agent skills, rules and prompts

L3-8B-Stheno-v3.3-32K-GGUF

mradermacher · Kit

Static GGUF files of Sao10K's Stheno 8B model in sizes from 3.3 GB to 16.2 GB. For people who run an 8B model on their own computer, under a non-commercial lic…

KnowLine-4B-Gen5.5-GGUF

mradermacher · Kit

Static GGUF files of PelaAI's KnowLine 4B model in sizes from 2.1 GB to 8.8 GB, with English and Chinese listed. For people who run a small model on their own…

Muse Glimmer 30B GGUF by meta-models

meta-models · Kit

GGUF builds of a 30-billion-parameter agentic model for llama.cpp, with an optional image encoder and a speculative decoding drafter. They suit people who run…

dale-9b (GGUF)

manuelgscom · Kit

Turns a Spanish or English request into one Linux bash command, returned as a small JSON object. For terminal users and developers who want a local command hel…

askmdb-9b-GGUF

manuelgscom · Kit

Writes a read-only MongoDB aggregate pipeline from a plain Spanish or English question. A GGUF copy of a Qwen3.5-9B fine-tune that runs locally with llama.cpp,…

Z-Image-Turbo-GGUF by leejet

leejet · Kit

Generates images from text on modest GPUs, using quantized Z-Image-Turbo files made for stable-diffusion.cpp. For people who run image models on their own comp…

Qwen3.8-27B-GSQ-RCO-IQ3_S-recovered-GGUF

Joakimpalm-Zen · Kit

Shrinks Qwen3.8-27B to a 3-bit IQ3_S GGUF with retrained scales. A research file for people who study quantization, not a faithful stand-in for the original mo…

humanizer-GGUF

jialinyyzz · Kit

Rewrites AI-written drafts in English and Chinese so they read like a person wrote them, keeping numbers, dates, names and quotes. A 12B model in GGUF files fo…

Qwopus3.8-27B-Flash-GGUF

Jackrong · Kit

Cuts reasoning time and cost for long agent tasks, as a GGUF build of a Qwen3.8-27B fine-tune. Made for people who run agent loops on their own machine and wan…

Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Jackrong · Kit

Thinks through problems step by step inside think tags, as a 4B Qwen3.5 model fine-tuned on reasoning chains and packaged as GGUF. For people who run a small r…

Qwen3.8-Flash-Coder APEX-I-MiniPlus V2.1 GGUF

IsValorum · Kit

An English-only coding model in GGUF, a 42.6B mixture-of-experts quant of about 21.8 GB, for code completion, refactoring and agentic tool calls in llama.cpp o…

K2-Horizon-3.7B-GGUF

IFM · Kit

GGUF files of the 3.7B K2-Horizon text model in six precision levels, from BF16 to Q4_K_M, for running with llama.cpp. The model has a 512K-token context windo…

granite-4.2-8b GGUF

ibm-granite · Kit

Holds GGUF copies of IBM's Granite 4.2 8B model in several quantization levels, ready for llama.cpp. For people who want to run the model locally and read its…

Granite-4.2-3B (GGUF)

ibm-granite · Kit

Packages IBM's Granite 4.2 3B text model as GGUF files for local use. The 4-bit weights are estimated at about 1.8 GB, for people who want a compact model unde…

Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

hesamation · Kit

Runs a reasoning-tuned Qwen3.6-35B-A3B on your own machine as GGUF files in four quant sizes, trained on Claude Opus 4.6 style reasoning data. For people who w…

phonon-31m English for llama.cpp

gradium · Kit

Turns English text into speech from the command line or a local server, as a GGUF copy of the Phonon 31M model for llama.cpp. It suits developers who already r…

gemma-4-31B-it-qat-q4_0-gguf

google · Kit

Runs Google's Gemma 4 31B instruction-tuned model as a 4-bit GGUF file that reads text and images and answers in text. It suits developers and enthusiasts with…

Qwen2.5-Coder-1.5B Q8_0 GGUF

ggml-org · Kit

Runs Qwen2.5-Coder 1.5B on your own machine as a Q8_0 GGUF file through llama.cpp, from the command line or as a local server. It suits developers who want a s…

embeddinggemma-2 GGUF

ggml-org · Kit

Runs a GGUF copy of Google's embeddinggemma-2, a 271M feature extraction model, with the llama command or the Llama app. For developers who want a small text e…

Clef-GGUF

ggml-org · Kit

GGUF files of Cloudflare's Clef decision model, which takes image and text input. Served with llama.cpp tools and called through a decision API path. For devel…

Kvark-Sparkle-1.0-27B

Egzakta · Kit

Reasons over images and text with fewer thinking tokens than its base Qwen3.8-27B, so answers arrive in about half the time at similar accuracy, per its card.…

Gemma-3-12b-it-MAX-HORROR-Imatrix-GGUF

DavidAU · Kit

Writes fiction with a tint of horror. GGUF builds of Gemma 3 12B instruct, quantized with an imatrix made from a horror model, for creative writers who run mod…

Qwen3-ASR-1.7B GGUF

cstr · Kit

Turns speech, singing and songs into text, or into English, with quantized GGUF files of Qwen3-ASR-1.7B for CrispASR. For people who want local transcription a…

MOSS-Transcribe-Diarize-GGUF

cstr · Kit

Turns audio into timestamped transcripts with speaker labels in one pass. A GGUF conversion of a 0.9B model for CrispASR, for people who want meeting or interv…

Qwen 3.6 35B-A3B REAP-48 v2 GGUF

crucible-labs · Kit

Runs a pruned and quantized Qwen3.6-35B-A3B in an 8.78 GiB GGUF file for llama.cpp, closer to the unquantized weights than the first release. For people with l…

ConeML 1.2B Experimental

ConeML · Kit

Names the tallest, oldest or first item among facts you supply, as a small English research model in FP32 Safetensors and Q8_0 GGUF files. For researchers, non…

t5-v1_1-xxl-encoder-gguf

city96 · Kit

A GGUF conversion of Google's T5 v1.1 XXL text encoder, for turning text into embeddings in llama.cpp or feeding image generation models through ComfyUI-GGUF.…

wan-gguf

calcuis · Kit

GGUF quantized versions of the Wan video models for text-to-video work in ComfyUI or diffusers, including small 1.3b files for older machines. For people who m…

pig-vae

calcuis · Kit

A small GGUF VAE in the pig architecture for image and video workflows, with a loader in the gguf-node package. Aimed at faster runs and lower memory use on ol…

Qwen3.5-9B GGUF (ShapeLearn)

byteshape · Kit

GGUF copies of Qwen3.5-9B, a model that reads text and images, compressed with ByteShape's ShapeLearn for llama.cpp. Variants for GPUs and CPUs, from about 3 G…

North-Mini-Code-1.0 GGUF

byteshape · Kit

GGUF copies of the North-Mini-Code-1.0 coding model, compressed with ByteShape's ShapeLearn for GPU use in llama.cpp. Four sizes from 12.1 GB to 21.5 GB, for d…

Qwen3.5-4B GGUF

bartowski · Kit

Imatrix GGUF quantizations of Qwen3.5-4B, a 4.3B image-text model with MTP layers, with the 4-bit file near 3 GB. For people who run a small model locally.

MiniCPM5-2B-GGUF by bartowski

bartowski · Kit

Quantized GGUF copies of the MiniCPM5-2B text model in many sizes, made with llama.cpp and an importance matrix. For people running a small English and Chinese…

Llama-3.2-1B-Instruct GGUF

bartowski · Kit

GGUF quantizations of Llama-3.2-1B-Instruct, a 1.2B text model in eight languages, with the 4-bit file near 0.8 GB. For people who run a tiny local model.

gugujiji_novel-humanize-4b-GGUF

bartowski · Kit

Quantized GGUF copies of the novel-humanize-4b Chinese text model, offered in sizes from full precision down to small files. For people who run a 4B-parameter…

granite-4.2-3b-GGUF

bartowski · Kit

Quantized GGUF copies of IBM's granite-4.2-3b text model, in many sizes from full precision down to small 3-bit files. For people who run a small chat model on…

google_gemma-4-31B-it-GGUF

bartowski · Kit

Quantized GGUF files of Google's Gemma 4 31B instruction model, from 17.15 GB to 61.41 GB, made by bartowski with an importance matrix. Reads images and text.…

Cloudflare clef GGUF

bartowski · Kit

Static GGUF quantizations of Cloudflare's clef decision model, which scores every answer option to typed questions about a state in one pass instead of writing…

MOSS-Image-SFT GGUF

axiomofmind · Kit

Unofficial GGUF files of the MOSS-Image-SFT diffusion transformer in Q8_0 and Q4_K_S, for running text-to-image locally with stable-diffusion.cpp. Needs a sepa…

Ming 3.0 TTS 0.5B GGUF

audio-cpp · Kit

GGUF packages of Ming 3.0 TTS 0.5B for the audio.cpp runtime: speech from text, voice cloning and voice design in seven languages, with mono 44.1 kHz output an…

Apodex-1.1-mini-GGUF

apodex · Kit

Reasoning model for long research tasks that works with files, data, code and tools, packaged as GGUF files you can host yourself. Suits researchers and develo…

Surya 2.5 GGUF

datalab-to · Kit

Reads text, tables and layout from document images and returns it as text. GGUF builds of the Surya 2.5 OCR model for llama.cpp, for people who run document OC…

Qwen3.5-35B-A3B-GGUF

unsloth · Kit

Reads text and images, writes code and calls tools on your own machine, as Unsloth's refreshed GGUF files for the Qwen3.5 35B-A3B vision-language model. For de…

Hy-MT2-7B-GGUF

tencent · Kit

Translates text among 33 languages and follows translation instructions, as a GGUF copy of Tencent's 7B model for llama.cpp. For developers who run translation…

Hy-MT2-1.8B-GGUF

tencent · Kit

Translates text among 33 languages and obeys translation instructions, as a 1.8B model in GGUF format for llama.cpp. For developers who want a small local tran…

BaronLLM Offensive Security LLM Q6_K GGUF

AlicanKiraz0 · Kit

Answers security questions and helps plan authorized red-team exercises, as a Q6_K GGUF fine-tune of Llama 3.1 8B. For security researchers working on systems…

GigaChat3.1-10B-A1.8B-GGUF

ai-sage · Kit

Chats in Russian and English, writes code and calls functions, as a compact mixture of experts model in GGUF files. For people who run assistants on their own…

Qwen3.8-27B Agention Precision GGUF

agentionai · Kit

Packs Qwen3.8-27B as llama.cpp GGUF files in eight sizes from 8.95 to 16.35 GiB, plus a vision projector. The author reports less drift from the BF16 model tha…

Occamy-1.0

Accio-Lab · Kit

An open 35B image and text model from Accio-Lab, based on Qwen3.6-35B-A3B, in BF16, GGUF, FP8, NVFP4 and MLX formats. For teams that serve a large model.

Qwen3.8-Flash-Next-125B-UltraLite-37GiB-GGUF

0xKitkat · Kit

Squeezes the Qwen3.8-Flash-Next mixture-of-experts model into about 37 GiB of text-only GGUF files for experiments. It needs a patched llama.cpp build that com…