Bonsai-27B-gguf
prism-ml · Kit
Runs a 27B-class reasoning model as a 1-bit GGUF file of about 3.9 GB for llama.cpp, so it fits a laptop or one GPU. For people who want local reasoning on eve…
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
prism-ml · Kit
Runs a 27B-class reasoning model as a 1-bit GGUF file of about 3.9 GB for llama.cpp, so it fits a laptop or one GPU. For people who want local reasoning on eve…
Mia-AiLab · Kit
A 2.9 bits-per-weight EXL3 quantization of DeepSeek-V4.1-Flash-1017 that reads text and images. It cuts the model to about 210 GB for exllamav3 runtimes, and t…
lmstudio-community · Kit
A GGUF quantization of Qwen's Qwen3.8-27B made by the LM Studio team with llama.cpp, for people who run a 27B model on their own computer.
KRAFTON · Kit
Runs a 28.8B mixture-of-experts model tuned for Korean chat, reasoning and tool-using agents in llama.cpp. GGUF copy of Raon-1 mini preview for people who run…
empero-ai · Kit
Runs a small 2B reasoning model on phones, laptops and single-board computers, as GGUF files in five quant levels. A distillation of a large Qwen3.8 model, pac…
bartowski · Kit
GGUF quantizations of Nanbeige4.3-33B, made by bartowski with an importance matrix, from about 21 GB to 66 GB. For running a 33B English and Chinese text model…
TinyLlama · Kit
Chats in plain text as a small 1.1B language model that runs with little memory. For developers and researchers who want a compact chat model built on a Llama-…
kkt94 · Kit
Answers questions about video clips with a 5.1B model that joins a frozen V-JEPA 2.1 video encoder to Qwen3-4B-Instruct-2507, for people who need video underst…
kkt94 · Kit
Answers questions about video clips with a 2B model that joins a frozen V-JEPA 2.1 video encoder to Qwen3-1.7B, for people who need video understanding on one…
kkt94 · Kit
Answers questions about video clips with a 4.2B model that joins a frozen V-JEPA 2.1 video encoder to Llama-3.2-3B-Instruct, for people who need video understa…
kkt94 · Kit
Answers questions about video clips with a small 1.5B model that joins a frozen V-JEPA 2.1 video encoder to Llama-3.2-1B-Instruct, for people who need video un…
JonathanColetti · Kit
Fixes the repeat loops that Qwen3.5-0.8B falls into in thinking mode by editing two weight tensors directly, with no training. A small image-text model for Tra…
ggml-org · Kit
Runs Qwen3.8-27B, a 26.9B model that takes images and text and replies in text, as a GGUF file for local use through the llama tools. Made for people who want…
empero-ai · Kit
Runs a 4B reasoning model on a laptop or a mid-range graphics card, as GGUF files in five quant levels. A distillation of a large Qwen3.8 model, packaged by Em…
unsloth · Kit
Gemma 4 12B in GGUF form, trained with quantization-aware training so a 4-bit copy keeps near-bfloat16 quality. For people running Gemma locally with llama.cpp…
kkt94 · Kit
Answers questions about video clips by joining a frozen V-JEPA 2.1 video encoder to Llama-3.1-8B-Instruct, made for people working on video understanding.
Qwen · Kit
Runs Qwen3-8B as quantized GGUF files in llama.cpp or Ollama, with a thinking mode for math, code and logic and a plain mode for chat. For people who want a lo…
kkt94 · Kit
Answers questions about video clips with a 9.2B model that joins a frozen V-JEPA 2.1 video encoder to Qwen3-8B, for people who need video understanding on a GP…
empero-ai · Kit
GGUF quantizations of Empero's Qwen3.8-9B, a reasoning model distilled from a larger Qwen3.8 into the Qwen3.5-9B design, for llama.cpp, Ollama, LM Studio and s…
AtomicChat · Kit
Packs the ZONOS3-Mini text-to-speech model as GGUF files for llama.cpp, with 27 built-in voices and six backbone sizes from 0.41 to 1.61 GB. For developers run…