Qwen3.8-27B Fable-5 Coding Distilled GGUF
mradermacher · Kit
GGUF quantized files of a 27.3B coding-distilled Qwen3.8 model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit developers who run a cod…
New
AI skills and agents for developers
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Categories and filters
Listings
OneJev1.6-4B-GGUF
mradermacher · Kit
Quantized GGUF copies of OneJev1.6-4B, from about 2 GB to 8.5 GB, for running the model on your own computer. The card does not say what the base model is for.
New
L3-8B-Stheno-v3.3-32K-GGUF
mradermacher · Kit
Static GGUF files of Sao10K's Stheno 8B model in sizes from 3.3 GB to 16.2 GB. For people who run an 8B model on their own computer, under a non-commercial lic…
New
KnowLine-4B-Gen5.5-GGUF
mradermacher · Kit
Static GGUF files of PelaAI's KnowLine 4B model in sizes from 2.1 GB to 8.8 GB, with English and Chinese listed. For people who run a small model on their own…
New
Muse Glimmer 30B GGUF by meta-models
meta-models · Kit
GGUF builds of a 30-billion-parameter agentic model for llama.cpp, with an optional image encoder and a speculative decoding drafter. They suit people who run…
New
dale-9b (GGUF)
manuelgscom · Kit
Turns a Spanish or English request into one Linux bash command, returned as a small JSON object. For terminal users and developers who want a local command hel…
New
askmdb-9b-GGUF
manuelgscom · Kit
Writes a read-only MongoDB aggregate pipeline from a plain Spanish or English question. A GGUF copy of a Qwen3.5-9B fine-tune that runs locally with llama.cpp,…
New
Qwopus3.8-27B-Flash-GGUF
Jackrong · Kit
Cuts reasoning time and cost for long agent tasks, as a GGUF build of a Qwen3.8-27B fine-tune. Made for people who run agent loops on their own machine and wan…
New
Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled-GGUF
Jackrong · Kit
Thinks through problems step by step inside think tags, as a 4B Qwen3.5 model fine-tuned on reasoning chains and packaged as GGUF. For people who run a small r…
New
Qwen3.8-Flash-Coder APEX-I-MiniPlus V2.1 GGUF
IsValorum · Kit
An English-only coding model in GGUF, a 42.6B mixture-of-experts quant of about 21.8 GB, for code completion, refactoring and agentic tool calls in llama.cpp o…
New
K2-Horizon-3.7B-GGUF
IFM · Kit
GGUF files of the 3.7B K2-Horizon text model in six precision levels, from BF16 to Q4_K_M, for running with llama.cpp. The model has a 512K-token context windo…
New
granite-4.2-8b GGUF
ibm-granite · Kit
Holds GGUF copies of IBM's Granite 4.2 8B model in several quantization levels, ready for llama.cpp. For people who want to run the model locally and read its…
New
Granite-4.2-3B (GGUF)
ibm-granite · Kit
Packages IBM's Granite 4.2 3B text model as GGUF files for local use. The 4-bit weights are estimated at about 1.8 GB, for people who want a compact model unde…
New
Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF
hesamation · Kit
Runs a reasoning-tuned Qwen3.6-35B-A3B on your own machine as GGUF files in four quant sizes, trained on Claude Opus 4.6 style reasoning data. For people who w…
New
phonon-31m English for llama.cpp
gradium · Kit
Turns English text into speech from the command line or a local server, as a GGUF copy of the Phonon 31M model for llama.cpp. It suits developers who already r…
New
gemma-4-31B-it-qat-q4_0-gguf
google · Kit
Runs Google's Gemma 4 31B instruction-tuned model as a 4-bit GGUF file that reads text and images and answers in text. It suits developers and enthusiasts with…
New
Qwen2.5-Coder-1.5B Q8_0 GGUF
ggml-org · Kit
Runs Qwen2.5-Coder 1.5B on your own machine as a Q8_0 GGUF file through llama.cpp, from the command line or as a local server. It suits developers who want a s…
New
embeddinggemma-2 GGUF
ggml-org · Kit
Runs a GGUF copy of Google's embeddinggemma-2, a 271M feature extraction model, with the llama command or the Llama app. For developers who want a small text e…
New
Clef-GGUF
ggml-org · Kit
GGUF files of Cloudflare's Clef decision model, which takes image and text input. Served with llama.cpp tools and called through a decision API path. For devel…
New
Kvark-Sparkle-1.0-27B
Egzakta · Kit
Reasons over images and text with fewer thinking tokens than its base Qwen3.8-27B, so answers arrive in about half the time at similar accuracy, per its card.…
New