Kits of AI agent skills, rules and prompts

Sage-A1.5 GGUF (Q4_K_M)

InternScience · Kit

Runs Sage-A1.5, a 35B mixture-of-experts agentic model for long scientific tasks, as a 4-bit GGUF file. It can split work across subagents and check its own pr…

gemma-4-12B-it-qat-q4_0-gguf

google · Kit

Runs Google's Gemma 4 12B instruction-tuned model in a 4-bit GGUF file made with quantization-aware training. Reads text and images, and suits laptops and cons…

Qwen3.8-2B-Distill-GGUF

empero-ai · Kit

Runs a small 2B reasoning model on phones, laptops and single-board computers, as GGUF files in five quant levels. A distillation of a large Qwen3.8 model, pac…

Nanbeige_Nanbeige4.3-33B-GGUF

bartowski · Kit

GGUF quantizations of Nanbeige4.3-33B, made by bartowski with an importance matrix, from about 21 GB to 66 GB. For running a 33B English and Chinese text model…

Qwen2.5-VL-7B-Instruct-GGUF

unsloth · Kit

Unsloth's GGUF files of Qwen2.5-VL-7B-Instruct, a vision-language model that reads images, charts, documents and long videos and can output coordinates and str…

gemma-4-E4B-it-GGUF

unsloth · Kit

A 4-bit GGUF copy of Google's Gemma 4 E4B instruction model, packaged by Unsloth for running on your own machine. It reads text and images and answers in text.

gemma-4-12b-it-GGUF

unsloth · Kit

Unsloth's GGUF quantized copy of Google's instruction-tuned Gemma 4 12B, a model that takes text, images, audio and video and writes text, for running locally.

embeddinggemma-2-GGUF

unsloth · Kit

Turns text into 768-dimensional vectors for on-device search, retrieval and clustering. The base model also covers images, video and audio. Packaged as GGUF by…

Qwen3.8-27B-GGUF by ggml-org

ggml-org · Kit

Runs Qwen3.8-27B, a 26.9B model that takes images and text and replies in text, as a GGUF file for local use through the llama tools. Made for people who want…

Qwen3.8-4B-Distill-GGUF

empero-ai · Kit

Runs a 4B reasoning model on a laptop or a mid-range graphics card, as GGUF files in five quant levels. A distillation of a large Qwen3.8 model, packaged by Em…

Spark-X2.6-1.7B-GGUF

XHToken · Kit

Runs a small 1.7B on-device language model from XHToken as 4-bit GGUF files, for chat, coding and agent tasks in English and Chinese, with adjustable thinking…

gemma-4-12B-it-qat-GGUF

unsloth · Kit

Gemma 4 12B in GGUF form, trained with quantization-aware training so a 4-bit copy keeps near-bfloat16 quality. For people running Gemma locally with llama.cpp…

Bielik-11B-v3.1-Instruct GGUF

speakleash · Kit

Chat model that answers in Polish, English and six other languages, packed as GGUF files in five sizes for llama.cpp or Ollama. For people who want an instruct…

Qwen3.5-4B-3D-Coder-MTP-Repacked

prithivMLmods · Kit

A repacked copy of ccore's Qwen3.5-4B-3D-Coder, a small model tuned to write coding answers and Three.js 3D scenes, with GGUF files that support multi-token pr…

GLM-5.3-Flash-Coder-RCO-152E-GGUF

lapadatbogdan · Kit

Runs a pruned GLM-5.3-Flash coding and agent model on a home PC, as GGUF files in five quant sizes. It keeps 152 of 288 experts per layer, cutting a 321B model…

gemma-4-31B-it-GGUF

unsloth · Kit

Runs Google's Gemma 4 31B instruction-tuned model locally from Unsloth's GGUF files, with text and image input and a long context. Suits developers who want a…

Idol-GGUF

TimeLordRaps · Kit

An 8-bit GGUF build of SperiD Labs' Idol that turns one image into a 3D Gaussian point cloud and a mesh, run locally with idol.cpp. For developers working on i…

Qwen3-8B-GGUF

Qwen · Kit

Runs Qwen3-8B as quantized GGUF files in llama.cpp or Ollama, with a thinking mode for math, code and logic and a plain mode for chat. For people who want a lo…

GLM-5.3-Flash Maya GGUF

peasantsmith · Kit

Five GGUF compressions of GLM-5.3-Flash, a 321B mixture-of-experts model, sized from 73.4 GB to 156.3 GB for Project Maya, which spreads the model across GPU,…

Qwen3.8-9B-Distill-GGUF

empero-ai · Kit

GGUF quantizations of Empero's Qwen3.8-9B, a reasoning model distilled from a larger Qwen3.8 into the Qwen3.5-9B design, for llama.cpp, Ollama, LM Studio and s…

ZONOS3-Mini GGUF

AtomicChat · Kit

Packs the ZONOS3-Mini text-to-speech model as GGUF files for llama.cpp, with 27 built-in voices and six backbone sizes from 0.41 to 1.61 GB. For developers run…

Gemma4-12B v2 Coding + Agentic Edition

yuxinlu1 · Kit

A GGUF fine-tune of Google's Gemma 4 12B instruction model for coding and tool-using agent work, sized to run offline on a machine with about 4.5 GB of free me…

Qwen3.8-35B-A3B-Distill-GGUF

empero-ai · Kit

Runs a 35B Mixture-of-Experts model with about 3B active parameters per token from GGUF files in ten sizes, plus a vision projector. For llama.cpp, Ollama, LM…

Qwen3.5-4B-GGUF

unsloth · Kit

Unsloth's GGUF quantized copy of Qwen3.5-4B, a small model that reads images and text and answers in text, for people running models locally.

GLM-5.3-Flash-GGUF

unsloth · Kit

Runs Unsloth's GGUF copy of the GLM-5.3-Flash text model on your own hardware, a large open model its authors aim at coding and agent work. For people with ple…

Qwen3.6-35B-A3B-MTP-GGUF

unsloth · Kit

Runs Qwen3.6-35B-A3B locally from Unsloth's GGUF files with multi-token prediction for faster decoding in llama.cpp. Suits developers who want a local agentic…

flint-GGUF

unsloth · Kit

Runs Flint, a 39.8B mixture-of-experts model for coding agents that uses about 2.5B parameters per token, from Unsloth GGUF files. For developers who run codin…

Qwopus3.8-27B-Coder-Flash-GGUF

Jackrong · Kit

Helps with coding and tool-using agent work as a GGUF fine-tune of Qwen3.8-27B, trained on about 200,000 code, agent and reasoning examples. For developers who…

Alpie Seed 9B GGUF

169Pi · Kit

Runs Alpie Seed 9B, an image-and-text model from 169Pi AI, on your own machine through GGUF files in three bit depths. Suits developers who want local vision-l…

Qwen3.5-9B-GGUF

unsloth · Kit

Unsloth's GGUF quantized copy of Qwen3.5-9B, a mid-size model that reads images and text and answers in text, for people running models locally.

Qwen2.5-Coder-7B-Instruct-GGUF

Qwen · Kit

Runs a 7B instruction-tuned coding model from Qwen on your own machine, packed as GGUF files in eight quantization levels. Made for developers who want code he…

CCORE GLB-3D-Coder 1.7B

ccore · Kit

Writes a complete Three.js page for a game asset you describe, with a 3D preview and an Export GLB button. A fine-tuned Qwen3-1.7B in GGUF that runs on modest…

Thinklite-27B-GGUF

Sparset · Kit

A 4-bit GGUF copy of Thinklite-27B for llama.cpp that uses less reasoning per answer than its base model, for people running a 27B text model locally.

S5-nano-GGUF

maritaca-ai · Kit

Runs Maritaca AI's S5-nano, a 4B model tuned for Brazilian Portuguese with function calling and a think mode, from GGUF files of 2.8 to 8.7 GB for llama.cpp an…

Qwen3.8-27B-QSA-GGUF

higa2515 · Kit

Runs Qwen3.8-27B with sparse attention from GGUF files in Q8_0 and Unsloth Q4, Q5 and Q6 mixes, with text, image and video input. For Linux users with NVIDIA G…

Arete-27B-GGUF

AtomicChat · Kit

Runs Nous Research's Arete 27B, a Qwen3.8-27B fine-tune that reads text and images, from GGUF files in six sizes with measured quality losses. For people runni…

Spark-X2.6-4B-GGUF

XHToken · Kit

A compact 4B language model in GGUF form for on-device use, tuned for coding, agents and long context, with three thinking levels from none to high. Works in E…

MNN-Pocket-0.3B-GGUF

taobao-mnn · Kit

Runs a compact 0.3B Chinese and English language model from GGUF files of 192 to 726 MB, made for phones, laptops and other on-device use with llama.cpp, LM St…

Ornith-1.5-35B-A3B-GGUF

ornith-ai · Kit

Runs a 35B mixture-of-experts text model tuned for coding and agent work, using only about 3B parameters per token. This repository holds its GGUF files for lo…

Qwen3.6-35B-A3B-GGUF

unsloth · Kit

Runs Qwen3.6-35B-A3B, a mixture-of-experts model that reads images and text and uses about 3B parameters per token, from Unsloth GGUF files. For developers who…

BotPsy-0.8B-GGUFs

qvac · Kit

GGUF copies of the 0.8B BotPsy tool-calling model in BF16, Q8_0 and Q4_K_M, for running agent and function-calling work fully on your own device with llama.cpp.

Sharp-Spark-X2.6-4B-GGUF

peculiar-ragdoll · Kit

Runs a 4B coding model with long context on a graphics card with 6 GB of memory. These GGUF quants of Spark-X2.6-4B come in three sizes and use a coding-weight…

Qwen3.8-27B Turbo Brilliance NEO MAX MTP GGUF

DavidAU · Kit

Runs Qwen3.8-27B in GGUF form with a set of reasoning and instruct modes you switch from your prompt. For people who run local models and like to tune how the…

Raon-1 nano (GGUF)

KRAFTON · Kit

Packages the Raon-1 nano language model as GGUF files for llama.cpp, so developers can run a Korean and English chat model on their own computer. Four quant ty…

Ripple-65B-Preview-GGUF

AtomicChat · Kit

GGUF quantized files of the 65B Ripple Preview agentic-coding model, for running locally with llama.cpp. For people who run large open models on their own hard…

Alpie Seed 9B

169Pi · Kit

Reads text, images and video and handles reasoning and coding with a 9B open-weight model built on Qwen3.5-9B, with GGUF builds for light hardware. For develop…

Qwen3.8-27B GGUF (ShapeLearn Quantized)

byteshape · Kit

Runs Qwen3.8-27B as GGUF files quantized by ByteShape's ShapeLearn, in five GPU-sized options with vision input and MTP speculative decoding in llama.cpp. For…

DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF

ISTA-DASLab · Kit

GGUF versions of DeepSeek-V4.1-Flash-1017 at three small sizes, with each tensor quantized at its own precision. For people running a huge mixture-of-experts m…

DeepSeek-V4.1-Flash-1017-GGUF

unsloth · Kit

Unsloth's GGUF quantizations of DeepSeek-V4.1-Flash-1017, a huge image-and-text model, for running locally on a machine with 128 GB or more of RAM. For people…

Ornith-1.5-9B-GGUF

ornith-ai · Kit

Offers GGUF files of Ornith-1.5-9B, a 9B dense model trained through a self-improvement loop, for single-GPU use. Aimed at developers who want a small model wi…

Qwen3.8-Flash-Next-GSQ-RCO-Coder-GGUF

ISTA-DASLab · Kit

A coding-focused GGUF build of Qwen3.8-Flash-Next with half its experts removed, cutting 354 GB at BF16 to 58.4 GB while keeping image input. For people with l…

dale-0.8b-GGUF

manuelgscom · Kit

A small 4-bit GGUF model that turns a plain request in Spanish or English into one Linux bash command. It runs offline on a CPU inside the dale tool. For peopl…

Qwen3.8-27B-DSpine-b16-GGUF

aj9o9 · Kit

A GGUF draft model that speeds up Qwen3.8-27B in llama.cpp through speculative decoding, reaching about 125 tokens per second on code and math on one RTX 3090.…

Qwen3.8-Flash-Next-GSQ-RCO-GGUF

ISTA-DASLab · Kit

GGUF versions of Qwen3.8-Flash-Next at four sizes, with each tensor quantized at its own precision and a vision projector for image input. For people running a…

DeepSeek-V4.1-Flash-1017-GSQ-RCO-Coder-GGUF

ISTA-DASLab · Kit

An expert pruned and quantized GGUF of DeepSeek-V4.1-Flash-1017 from ISTA-DASLab, aimed at code and agent work, with transformer weights of 72.1 GB. Suits deve…

Qwen3.8-27B-GSQ-RCO-GGUF

ISTA-DASLab · Kit

ISTA-DASLab's GGUF versions of Qwen3.8-27B in four sizes, each tensor quantized at its own precision, with a vision projector for images. Suits people who run…

Qwen2.5-0.5B QLoRA Demo

shambhuraje · Kit

A Gradio demo for a small fine-tuned Qwen2.5 0.5B instruct model in GGUF form. Lets developers and learners try the compact model in a browser without installi…

Local Model Explorer

LocalLLaMA · Kit

Shows which GGUF quantized models fit your graphics card, Mac or CPU, for people who run language models on their own machine and want to pick a file that work…

LurisQA

AdityaMogare · Kit

Answers civil law questions in a chat window, using the fine-tuned LurisQA model in GGUF form. A Gradio app for law students, legal staff and developers buildi…

GGUF Model VRAM Calculator

DavidAU · Kit

Estimates how much video memory a GGUF model needs, in a static page that runs in your browser. Suits people choosing a quantized model that fits their graphic…