AI skills and agents for developers

gemma-3-12b-it-GGUF

unsloth · Kit

Answers questions and summarizes text, and reads images, from GGUF files of Google's Gemma 3 12B instruction model. It suits people who want to run it on their…

ERNIE-4.5-21B-A3B-Thinking-GGUF

unsloth · Kit

Works through logic, math, science and coding problems with a 21B mixture-of-experts model that activates 3B parameters per token, in GGUF files by Unsloth. Su…

bge-small-en-v1.5-GGUF

unsloth · Kit

Turns English text into embeddings for search and retrieval, in a small GGUF file of 33.2M parameters. For developers who build search or retrieval apps on mod…

Clef-LoRA-for-Qwen3.8-27B-GGUF

trevest · Kit

Adds Cloudflare Clef's decision head to a Qwen3.8-27B chat model, so one llama.cpp server on a 24 GB GPU both answers typed questions and chats. It is a LoRA a…

Sweep Next-Edit 1.5B (GGUF)

sweepai · Kit

Predicts your next code edit from the open file, recent diffs and current state, running locally as a 1.5B Q8_0 GGUF model. For developers who want edit autoco…

Qwen3-TTS GGUF

Serveurperso · Kit

Speaks text in several languages with named speakers and Mandarin dialects, and can clone a voice from a short clip, through the qwentts.cpp C++ runtime on CPU…

Sarvam-105B GGUF

sarvamai · Kit

The GGUF version of Sarvam-105B, a large mixture-of-experts model with a focus on Indian languages, split into 9 shards at 4-bit for llama.cpp. For people with…

MiMo-V2.6-Distill-Qwen-9B-GSQ-RCO-GGUF

sainez · Kit

Gives you a 9B coding and tool-calling model as one 3.64 GiB GGUF file, quantized at about 3.5 bits per weight for running on your own machine.

Unlimited-OCR-2-GGUF

RX5950XT · Kit

GGUF files of the Unlimited-OCR-2 document OCR model in BF16, Q8_0 and Q4_K_M, with a vision projector. They run only in a llama.cpp build with the repository'…

Qwen3-30B-A3B-GGUF

Qwen · Kit

A 30.5B mixture-of-experts chat model in GGUF format with only 3.3B parameters active per token, runnable in llama.cpp or ollama. It has thinking and plain mod…

Qwen3-0.6B-GGUF

Qwen · Kit

A small 0.6B chat model in GGUF format that runs locally in llama.cpp or ollama and can switch between thinking and plain replies. Suits people with modest har…

Qwen2.5-Coder-32B-Instruct-GGUF

Qwen · Kit

GGUF copy of a 32B code chat model that runs locally with llama.cpp. It writes, explains and fixes code from plain requests, for developers who want to run it…

pplx-decider-flash-gguf-v1.2

perplexity-ai · Kit

Sorts a request into the choices you set, from text and images, using a Q8_0 GGUF copy of a small decision model. For developers who can run a protocol v3 runt…

Luciole-8B-Instruct-1.1-GGUF

OpenLLM-France · Kit

Quantized GGUF copy of Luciole-8B-Instruct-1.1, an 8B text generation model for French and English, for running on your own computer. From LINAGORA's work in t…

SenseNova-6.8-Code2Video GSQ-RCO GGUF

OliviaRossi · Kit

Runs a 26.9B parameter SenseNova-6.8-Code2Video model as a mixed precision GGUF file, in a terminal chat or a local server. For people who want that model on t…

RealVisXL V5.0 GGUF

off-grid-ai · Kit

Generates pictures from text on your own computer using GGUF copies of RealVisXL V5.0 with stable-diffusion.cpp. For people who want local image generation wit…

Juggernaut XL v9 GGUF

off-grid-ai · Kit

Generates pictures from text on your own computer using GGUF copies of Juggernaut XL v9 with stable-diffusion.cpp. For people who want local image generation w…

Hermes-4.3-36B-GGUF

NousResearch · Kit

A 36B hybrid reasoning model in GGUF form that can think before it answers, write valid JSON and follow your system prompt. For people who run a large model on…

nomic-embed-text-v1.5-GGUF

nomic-ai · Kit

Turns sentences into vectors on your own machine through llama.cpp, using compact GGUF files, for search and RAG questions. For developers who want local text…

Qwen3.8-Flash-Next-DFlash2-GGUF

nazeshinjite · Kit

GGUF draft model that speeds up Qwen3.8-Flash-Next in llama.cpp through speculative decoding, in 334 MiB and 622 MiB files. It is not a standalone model, and i…