AI skills and agents for developers

Gemma4-12B v2 Coding + Agentic Edition

yuxinlu1 · Kit

A GGUF fine-tune of Google's Gemma 4 12B instruction model for coding and tool-using agent work, sized to run offline on a machine with about 4.5 GB of free me…

Qwen3.8-35B-A3B-Distill-GGUF

empero-ai · Kit

Runs a 35B Mixture-of-Experts model with about 3B active parameters per token from GGUF files in ten sizes, plus a vision projector. For llama.cpp, Ollama, LM…

Qwen3.5-4B-GGUF

unsloth · Kit

Unsloth's GGUF quantized copy of Qwen3.5-4B, a small model that reads images and text and answers in text, for people running models locally.

GLM-5.3-Flash-GGUF

unsloth · Kit

Runs Unsloth's GGUF copy of the GLM-5.3-Flash text model on your own hardware, a large open model its authors aim at coding and agent work. For people with ple…

Qwen3.6-35B-A3B-MTP-GGUF

unsloth · Kit

Runs Qwen3.6-35B-A3B locally from Unsloth's GGUF files with multi-token prediction for faster decoding in llama.cpp. Suits developers who want a local agentic…

flint-GGUF

unsloth · Kit

Runs Flint, a 39.8B mixture-of-experts model for coding agents that uses about 2.5B parameters per token, from Unsloth GGUF files. For developers who run codin…

Qwopus3.8-27B-Coder-Flash-GGUF

Jackrong · Kit

Helps with coding and tool-using agent work as a GGUF fine-tune of Qwen3.8-27B, trained on about 200,000 code, agent and reasoning examples. For developers who…

Alpie Seed 9B GGUF

169Pi · Kit

Runs Alpie Seed 9B, an image-and-text model from 169Pi AI, on your own machine through GGUF files in three bit depths. Suits developers who want local vision-l…

Qwen3.5-9B-GGUF

unsloth · Kit

Unsloth's GGUF quantized copy of Qwen3.5-9B, a mid-size model that reads images and text and answers in text, for people running models locally.

Qwen2.5-Coder-7B-Instruct-GGUF

Qwen · Kit

Runs a 7B instruction-tuned coding model from Qwen on your own machine, packed as GGUF files in eight quantization levels. Made for developers who want code he…

CCORE GLB-3D-Coder 1.7B

ccore · Kit

Writes a complete Three.js page for a game asset you describe, with a 3D preview and an Export GLB button. A fine-tuned Qwen3-1.7B in GGUF that runs on modest…

Thinklite-27B-GGUF

Sparset · Kit

A 4-bit GGUF copy of Thinklite-27B for llama.cpp that uses less reasoning per answer than its base model, for people running a 27B text model locally.

S5-nano-GGUF

maritaca-ai · Kit

Runs Maritaca AI's S5-nano, a 4B model tuned for Brazilian Portuguese with function calling and a think mode, from GGUF files of 2.8 to 8.7 GB for llama.cpp an…

Qwen3.8-27B-QSA-GGUF

higa2515 · Kit

Runs Qwen3.8-27B with sparse attention from GGUF files in Q8_0 and Unsloth Q4, Q5 and Q6 mixes, with text, image and video input. For Linux users with NVIDIA G…

Arete-27B-GGUF

AtomicChat · Kit

Runs Nous Research's Arete 27B, a Qwen3.8-27B fine-tune that reads text and images, from GGUF files in six sizes with measured quality losses. For people runni…

Spark-X2.6-4B-GGUF

XHToken · Kit

A compact 4B language model in GGUF form for on-device use, tuned for coding, agents and long context, with three thinking levels from none to high. Works in E…

MNN-Pocket-0.3B-GGUF

taobao-mnn · Kit

Runs a compact 0.3B Chinese and English language model from GGUF files of 192 to 726 MB, made for phones, laptops and other on-device use with llama.cpp, LM St…

Ornith-1.5-35B-A3B-GGUF

ornith-ai · Kit

Runs a 35B mixture-of-experts text model tuned for coding and agent work, using only about 3B parameters per token. This repository holds its GGUF files for lo…

Qwen3.6-35B-A3B-GGUF

unsloth · Kit

Runs Qwen3.6-35B-A3B, a mixture-of-experts model that reads images and text and uses about 3B parameters per token, from Unsloth GGUF files. For developers who…

BotPsy-0.8B-GGUFs

qvac · Kit

GGUF copies of the 0.8B BotPsy tool-calling model in BF16, Q8_0 and Q4_K_M, for running agent and function-calling work fully on your own device with llama.cpp.

Sharp-Spark-X2.6-4B-GGUF

peculiar-ragdoll · Kit

Runs a 4B coding model with long context on a graphics card with 6 GB of memory. These GGUF quants of Spark-X2.6-4B come in three sizes and use a coding-weight…

Qwen3.8-27B Turbo Brilliance NEO MAX MTP GGUF

DavidAU · Kit

Runs Qwen3.8-27B in GGUF form with a set of reasoning and instruct modes you switch from your prompt. For people who run local models and like to tune how the…

Raon-1 nano (GGUF)

KRAFTON · Kit

Packages the Raon-1 nano language model as GGUF files for llama.cpp, so developers can run a Korean and English chat model on their own computer. Four quant ty…

Ripple-65B-Preview-GGUF

AtomicChat · Kit

GGUF quantized files of the 65B Ripple Preview agentic-coding model, for running locally with llama.cpp. For people who run large open models on their own hard…

Alpie Seed 9B

169Pi · Kit

Reads text, images and video and handles reasoning and coding with a 9B open-weight model built on Qwen3.5-9B, with GGUF builds for light hardware. For develop…

Qwen3.8-27B GGUF (ShapeLearn Quantized)

byteshape · Kit

Runs Qwen3.8-27B as GGUF files quantized by ByteShape's ShapeLearn, in five GPU-sized options with vision input and MTP speculative decoding in llama.cpp. For…

DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF

ISTA-DASLab · Kit

GGUF versions of DeepSeek-V4.1-Flash-1017 at three small sizes, with each tensor quantized at its own precision. For people running a huge mixture-of-experts m…

DeepSeek-V4.1-Flash-1017-GGUF

unsloth · Kit

Unsloth's GGUF quantizations of DeepSeek-V4.1-Flash-1017, a huge image-and-text model, for running locally on a machine with 128 GB or more of RAM. For people…

Ornith-1.5-9B-GGUF

ornith-ai · Kit

Offers GGUF files of Ornith-1.5-9B, a 9B dense model trained through a self-improvement loop, for single-GPU use. Aimed at developers who want a small model wi…

Qwen3.8-Flash-Next-GSQ-RCO-Coder-GGUF

ISTA-DASLab · Kit

A coding-focused GGUF build of Qwen3.8-Flash-Next with half its experts removed, cutting 354 GB at BF16 to 58.4 GB while keeping image input. For people with l…

dale-0.8b-GGUF

manuelgscom · Kit

A small 4-bit GGUF model that turns a plain request in Spanish or English into one Linux bash command. It runs offline on a CPU inside the dale tool. For peopl…

Qwen3.8-27B-DSpine-b16-GGUF

aj9o9 · Kit

A GGUF draft model that speeds up Qwen3.8-27B in llama.cpp through speculative decoding, reaching about 125 tokens per second on code and math on one RTX 3090.…

Qwen3.8-Flash-Next-GSQ-RCO-GGUF

ISTA-DASLab · Kit

GGUF versions of Qwen3.8-Flash-Next at four sizes, with each tensor quantized at its own precision and a vision projector for image input. For people running a…

DeepSeek-V4.1-Flash-1017-GSQ-RCO-Coder-GGUF

ISTA-DASLab · Kit

An expert pruned and quantized GGUF of DeepSeek-V4.1-Flash-1017 from ISTA-DASLab, aimed at code and agent work, with transformer weights of 72.1 GB. Suits deve…

Qwen3.8-27B-GSQ-RCO-GGUF

ISTA-DASLab · Kit

ISTA-DASLab's GGUF versions of Qwen3.8-27B in four sizes, each tensor quantized at its own precision, with a vision projector for images. Suits people who run…

Qwen2.5-0.5B QLoRA Demo

shambhuraje · Kit

A Gradio demo for a small fine-tuned Qwen2.5 0.5B instruct model in GGUF form. Lets developers and learners try the compact model in a browser without installi…

Local Model Explorer

LocalLLaMA · Kit

Shows which GGUF quantized models fit your graphics card, Mac or CPU, for people who run language models on their own machine and want to pick a file that work…

GGUF Model VRAM Calculator

DavidAU · Kit

Estimates how much video memory a GGUF model needs, in a static page that runs in your browser. Suits people choosing a quantized model that fits their graphic…