gemma-4-12B-it-qat-GGUF
unsloth · Kit
Gemma 4 12B in GGUF form, trained with quantization-aware training so a 4-bit copy keeps near-bfloat16 quality. For people running Gemma locally with llama.cpp…
unsloth · Kit
Gemma 4 12B in GGUF form, trained with quantization-aware training so a 4-bit copy keeps near-bfloat16 quality. For people running Gemma locally with llama.cpp…
unsloth · Kit
Runs Google's Gemma 4 31B instruction-tuned model locally from Unsloth's GGUF files, with text and image input and a long context. Suits developers who want a…
TimeLordRaps · Kit
An 8-bit GGUF build of SperiD Labs' Idol that turns one image into a 3D Gaussian point cloud and a mesh, run locally with idol.cpp. For developers working on i…
Qwen · Kit
Runs Qwen3-8B as quantized GGUF files in llama.cpp or Ollama, with a thinking mode for math, code and logic and a plain mode for chat. For people who want a lo…
peonist-ai · Kit
Holds the model weights for halogen-flash-server, an engine that runs Qwen3.8-Flash-Next on AMD Strix Halo machines, for owners of that hardware who want the m…
feder-cr · Kit
A local decision model that answers yes-or-no, multiple-choice and score questions about a text on a laptop CPU in about 28 to 130 ms, returning a probability…
AtomicChat · Kit
Packs the ZONOS3-Mini text-to-speech model as GGUF files for llama.cpp, with 27 built-in voices and six backbone sizes from 0.41 to 1.61 GB. For developers run…
unsloth · Kit
Unsloth's GGUF quantized copy of Qwen3.5-4B, a small model that reads images and text and answers in text, for people running models locally.
jialinyyzz · Kit
Rewrites AI-written drafts such as emails, essays, reports and forum posts so they read like a person wrote them, in English and Chinese. A 12B model that keep…
DeepHat · Kit
A 7B coding model tuned for cybersecurity and DevOps work, fine-tuned from Qwen2.5-Coder-7B. For security and operations engineers who want a small local model…
unsloth · Kit
Runs Qwen3.6-35B-A3B locally from Unsloth's GGUF files with multi-token prediction for faster decoding in llama.cpp. Suits developers who want a local agentic…
unsloth · Kit
Runs Flint, a 39.8B mixture-of-experts model for coding agents that uses about 2.5B parameters per token, from Unsloth GGUF files. For developers who run codin…
inclusionAI · Kit
Generates text with a 7.9B hybrid reasoning model that activates only 1.3B parameters per token, so it fits local and low-resource setups. Suits developers who…
Cactus-Compute · Kit
A small on-device model from Cactus Compute for tool calling, structured extraction and text embeddings, used through the cactus Python package. For developers…
169Pi · Kit
Runs Alpie Seed 9B, an image-and-text model from 169Pi AI, on your own machine through GGUF files in three bit depths. Suits developers who want local vision-l…
unsloth · Kit
Unsloth's GGUF quantized copy of Qwen3.5-9B, a mid-size model that reads images and text and answers in text, for people running models locally.
openbmb · Kit
Generates text with a dense 2B-class model made for on-device and local use, covering coding, math, long context, tool use and agent tasks in English and Chine…
froggeric · Kit
Swaps Qwen's official chat templates for one drop-in Jinja file that fixes rendering errors, cache invalidation, wasted tokens and agent stalls. For people who…
Sparset · Kit
A 4-bit GGUF copy of Thinklite-27B for llama.cpp that uses less reasoning per answer than its base model, for people running a 27B text model locally.
qvac · Kit
A small 0.8B model for function calling and agent workflows, built on Qwen3.5-0.8B and light enough to run on a device, for developers who want a local assista…