Kits of AI agent skills, rules and prompts

Sweep Next-Edit 1.5B (GGUF)

sweepai · Kit

Predicts your next code edit from the open file, recent diffs and current state, running locally as a 1.5B Q8_0 GGUF model. For developers who want edit autoco…

Unlimited-OCR-2-GGUF

RX5950XT · Kit

GGUF files of the Unlimited-OCR-2 document OCR model in BF16, Q8_0 and Q4_K_M, with a vision projector. They run only in a llama.cpp build with the repository'…

pplx-decider-flash-gguf-v1.2

perplexity-ai · Kit

Sorts a request into the choices you set, from text and images, using a Q8_0 GGUF copy of a small decision model. For developers who can run a protocol v3 runt…

Qwen2.5-Coder-1.5B Q8_0 GGUF

ggml-org · Kit

Runs Qwen2.5-Coder 1.5B on your own machine as a Q8_0 GGUF file through llama.cpp, from the command line or as a local server. It suits developers who want a s…

ConeML 1.2B Experimental

ConeML · Kit

Names the tallest, oldest or first item among facts you supply, as a small English research model in FP32 Safetensors and Q8_0 GGUF files. For researchers, non…

MOSS-Image-SFT GGUF

axiomofmind · Kit

Unofficial GGUF files of the MOSS-Image-SFT diffusion transformer in Q8_0 and Q4_K_S, for running text-to-image locally with stable-diffusion.cpp. Needs a sepa…

Qwen3-1.7B-GGUF

Qwen · Kit

Gives you the small Qwen3 1.7B chat model as a q8_0 GGUF file for llama.cpp, with a switch between thinking and non-thinking replies. For people who want a lig…

Qwen3-Reranker-0.6B-Q8_0-GGUF

ggml-org · Kit

Ranks passages by relevance to a query, as an 8-bit GGUF copy of the Qwen3 0.6B reranker made with llama.cpp. For developers who want a small local reranker fo…

Meta-Llama-3.1-8B-Instruct-GGUF

bartowski · Kit

Quantized GGUF files of Meta's Llama 3.1 8B Instruct for local chat, such as 4.92 GB for Q4_K_M and 8.54 GB for Q8_0. Made by bartowski with an importance matr…

Qwen3.8-27B-GGUF by bartowski

bartowski · Kit

A set of GGUF quantizations of Qwen3.8-27B by bartowski, from Q8_0 down to 3-bit, made with an importance matrix. For people running a 27B vision-language mode…

Qwen3.8-27B-QSA-GGUF

higa2515 · Kit

Runs Qwen3.8-27B with sparse attention from GGUF files in Q8_0 and Unsloth Q4, Q5 and Q6 mixes, with text, image and video input. For Linux users with NVIDIA G…

BotPsy-0.8B-GGUFs

qvac · Kit

GGUF copies of the 0.8B BotPsy tool-calling model in BF16, Q8_0 and Q4_K_M, for running agent and function-calling work fully on your own device with llama.cpp.