Kits of AI agent skills, rules and prompts

Nanbeige4.3-33B-INT4

Nanbeige · Kit

INT4 quantized version of Nanbeige4.3-33B, a 33B model for coding and professional agent tasks, made with quantization-aware training. For developers who want…

GLM-5.3-Flash EXL3 4bpw for TensorFold

Mia-AiLab · Kit

4-bit EXL3 quantization of GLM-5.3-Flash prepared for TensorFold, with lower KL divergence than a popular TR3-4bpw quant at the same size. For people serving l…

Qwen3.8-27B-oQ4e-mtp

Jundot · Kit

Runs the 27B Qwen3.8 vision-language model on MLX in about 17.5 GB, reading text, images and video with a 262,144-token context. A mixed-precision quantization…

Qwen3.8-27B-GSQ-RCO-IQ3_S-recovered-GGUF

Joakimpalm-Zen · Kit

Shrinks Qwen3.8-27B to a 3-bit IQ3_S GGUF with retrained scales. A research file for people who study quantization, not a faithful stand-in for the original mo…

granite-4.2-8b GGUF

ibm-granite · Kit

Holds GGUF copies of IBM's Granite 4.2 8B model in several quantization levels, ready for llama.cpp. For people who want to run the model locally and read its…

Qwen3.5-4B GGUF

bartowski · Kit

Imatrix GGUF quantizations of Qwen3.5-4B, a 4.3B image-text model with MTP layers, with the 4-bit file near 3 GB. For people who run a small model locally.

Llama-3.2-1B-Instruct GGUF

bartowski · Kit

GGUF quantizations of Llama-3.2-1B-Instruct, a 1.2B text model in eight languages, with the 4-bit file near 0.8 GB. For people who run a tiny local model.

Cloudflare clef GGUF

bartowski · Kit

Static GGUF quantizations of Cloudflare's clef decision model, which scores every answer option to typed questions about a state in one pass instead of writing…

GLM-5.3-Flash EXL3 3.05bpw

albucino · Kit

Runs GLM-5.3-Flash locally on two RTX 3090 cards with 128 GB of RAM and a 262,144-token context, using a verified 3.05 bpw EXL3 quantization. For people hostin…

Qwen3.8-27B-SLQ-GGUF

kaitchup · Kit

Compresses Qwen3.8-27B into three GGUF files with different size and fidelity levels, using a custom statistically lossless quantization. For people who run th…

Qwen3.8-27B-AWQ-INT4

cyankiwi · Kit

A 4-bit AWQ quantization of Qwen3.8-27B by cyankiwi, a 27B vision-language model with thinking control. Weights are 21.02 GB and load in Transformers, vLLM or…

Qwen3.6-35B-A3B MTP GGUF

byteshape · Kit

Runs Qwen3.6-35B-A3B from a GGUF quantization with Multi-Token Prediction for faster GPU decoding in llama.cpp. Made by ByteShape for people running local mode…

Llama-3.2-3B-Instruct-GGUF

bartowski · Kit

GGUF quantizations of Meta's Llama-3.2-3B-Instruct, made by bartowski with an importance matrix, from about 1.8 GB to 6.4 GB. For running a small chat model lo…

KAT-Coder-V2.5-Dev GGUF

bartowski · Kit

Imatrix GGUF quantizations of Kwaipilot's KAT-Coder-V2.5-Dev, a 34.7B text model, with 4-bit files of about 19 GB or more. For people who run a large coder-nam…

Qwen2.5-Coder-14B-Instruct-GGUF

Qwen · Kit

Gives you the Qwen2.5-Coder 14B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp. For developers who want a stronger lo…

Qwen2.5-Coder-1.5B-Instruct-GGUF

Qwen · Kit

Gives you the small Qwen2.5-Coder 1.5B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp on a laptop. For developers who…

Qwen3.5-4B-GLB-3D-Coder-GGUF

mradermacher · Kit

Static GGUF quantizations of ccore/Qwen3.5-4B-GLB-3D-Coder, a 4.2B model, in sizes from 2.0 GB to 8.5 GB, plus two small multi-modal supplement files. Made by…

Nanbeige4.3-33B-GGUF-UltraOptimised-Curated-Protium

SolsticeAI · Kit

Offers GGUF quantizations of the 33.1B Nanbeige4.3 model for llama.cpp and Ollama, with a reasoning protocol and up to 524,288 tokens of context. For developer…

Qwen2.5-1.5B-Instruct-GGUF

Qwen · Kit

Gives you the small Qwen2.5 1.5B chat model as GGUF files in eight quantization sizes, for running with llama.cpp on a laptop or modest GPU. For people who wan…

DeepSeek-V4.1-Flash-1017 Maya GGUF

peasantsmith · Kit

Runs a 748B DeepSeek mixture-of-experts model on a home PC through two GGUF quantizations made for Project Maya. For people with a big-RAM machine and a fast S…