Qwen3.5-9B-MTP-GGUF
unsloth · Kit
GGUF copies of Qwen3.5 9B that support multi-token-prediction speculative decoding in llama.cpp for faster generation. For people running the model locally who…
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
unsloth · Kit
GGUF copies of Qwen3.5 9B that support multi-token-prediction speculative decoding in llama.cpp for faster generation. For people running the model locally who…
unsloth · Kit
Reads images and text and answers in text, as a small GGUF copy of Qwen3.5-0.8B by unsloth. Meant for local prototyping, fine-tuning and research.
unsloth · Kit
Runs OpenAI's open-weight gpt-oss-20b reasoning model on your own computer, packed as GGUF files by unsloth. Suits developers who want a local model with adjus…
turboderp · Kit
EXL3 quantized copies of Qwen3.8-27B in many bits-per-weight sizes, from 1.40 to 6.00. For people running the 27B model locally with ExLlamaV3 on limited GPU m…
Supertone · Kit
Turns text into speech in 31 languages, running on your own device through ONNX Runtime with no cloud call. For developers who want fast local voice output wit…
prism-ml · Kit
Runs a 27B-class reasoning model as a 1-bit GGUF file of about 3.9 GB for llama.cpp, so it fits a laptop or one GPU. For people who want local reasoning on eve…
peculiar-ragdoll · Kit
Compressed GGUF copies of the 4B Spark-X2.5 coding model, tuned for long context on GPUs with about 6 GB of memory. Made for developers who want a local coder…
peculiar-ragdoll · Kit
Replaces the chat template of Qwen3.5, 3.6 and 3.8 models so they think less before answering and write tighter replies. For people running Qwen locally for co…
mlx-community · Kit
4-bit MLX conversion of Qwen3.8-27B that reads text and images and answers in text, run with the mlx-vlm tool. For developers who want to run a vision-language…
google · Kit
Takes text, images and audio and writes text answers, in one 12B instruction-tuned model from Google DeepMind with a 256K-token context and configurable thinki…
DRUPEs · Kit
A 2B coding and chat model built on MiniCPM5-2B that is much better at web apps needing several features in one component. For developers who want a small loca…
bartowski · Kit
GGUF quantizations of Nanbeige4.3-33B, made by bartowski with an importance matrix, from about 21 GB to 66 GB. For running a 33B English and Chinese text model…
XHToken · Kit
Generates text with a compact 1.7B model for on-device use, with three adjustable thinking levels. Suits developers who want coding, agent and long-context hel…
unsloth · Kit
Unsloth's GGUF files of Qwen2.5-VL-7B-Instruct, a vision-language model that reads images, charts, documents and long videos and can output coordinates and str…
unsloth · Kit
Unsloth's GGUF quantized copy of Google's instruction-tuned Gemma 4 12B, a model that takes text, images, audio and video and writes text, for running locally.
ggml-org · Kit
Runs Qwen3.8-27B, a 26.9B model that takes images and text and replies in text, as a GGUF file for local use through the llama tools. Made for people who want…
ConwayResearch · Kit
Turns English speech into text with a 0.6B model in a 163 MB download, built on NVIDIA's Parakeet TDT 0.6B v3. For developers and Apple-silicon users who want…
XHToken · Kit
Runs a small 1.7B on-device language model from XHToken as 4-bit GGUF files, for chat, coding and agent tasks in English and Chinese, with adjustable thinking…
unsloth · Kit
Gemma 4 12B in GGUF form, trained with quantization-aware training so a 4-bit copy keeps near-bfloat16 quality. For people running Gemma locally with llama.cpp…
unsloth · Kit
Runs Google's Gemma 4 31B instruction-tuned model locally from Unsloth's GGUF files, with text and image input and a long context. Suits developers who want a…
TimeLordRaps · Kit
An 8-bit GGUF build of SperiD Labs' Idol that turns one image into a 3D Gaussian point cloud and a mesh, run locally with idol.cpp. For developers working on i…
Qwen · Kit
Runs Qwen3-8B as quantized GGUF files in llama.cpp or Ollama, with a thinking mode for math, code and logic and a plain mode for chat. For people who want a lo…
peonist-ai · Kit
Holds the model weights for halogen-flash-server, an engine that runs Qwen3.8-Flash-Next on AMD Strix Halo machines, for owners of that hardware who want the m…
feder-cr · Kit
A local decision model that answers yes-or-no, multiple-choice and score questions about a text on a laptop CPU in about 28 to 130 ms, returning a probability…
AtomicChat · Kit
Packs the ZONOS3-Mini text-to-speech model as GGUF files for llama.cpp, with 27 built-in voices and six backbone sizes from 0.41 to 1.61 GB. For developers run…
unsloth · Kit
Unsloth's GGUF quantized copy of Qwen3.5-4B, a small model that reads images and text and answers in text, for people running models locally.
DeepHat · Kit
A 7B coding model tuned for cybersecurity and DevOps work, fine-tuned from Qwen2.5-Coder-7B. For security and operations engineers who want a small local model…
unsloth · Kit
Runs Qwen3.6-35B-A3B locally from Unsloth's GGUF files with multi-token prediction for faster decoding in llama.cpp. Suits developers who want a local agentic…
unsloth · Kit
Runs Flint, a 39.8B mixture-of-experts model for coding agents that uses about 2.5B parameters per token, from Unsloth GGUF files. For developers who run codin…
inclusionAI · Kit
Generates text with a 7.9B hybrid reasoning model that activates only 1.3B parameters per token, so it fits local and low-resource setups. Suits developers who…
Cactus-Compute · Kit
A small on-device model from Cactus Compute for tool calling, structured extraction and text embeddings, used through the cactus Python package. For developers…
169Pi · Kit
Runs Alpie Seed 9B, an image-and-text model from 169Pi AI, on your own machine through GGUF files in three bit depths. Suits developers who want local vision-l…
unsloth · Kit
Unsloth's GGUF quantized copy of Qwen3.5-9B, a mid-size model that reads images and text and answers in text, for people running models locally.
openbmb · Kit
Generates text with a dense 2B-class model made for on-device and local use, covering coding, math, long context, tool use and agent tasks in English and Chine…
froggeric · Kit
Swaps Qwen's official chat templates for one drop-in Jinja file that fixes rendering errors, cache invalidation, wasted tokens and agent stalls. For people who…
Sparset · Kit
A 4-bit GGUF copy of Thinklite-27B for llama.cpp that uses less reasoning per answer than its base model, for people running a 27B text model locally.
qvac · Kit
A small 0.8B model for function calling and agent workflows, built on Qwen3.5-0.8B and light enough to run on a device, for developers who want a local assista…
KRAFTON · Kit
Provides Raon-1 nano as 4-bit MLX weights for Apple silicon, so developers can run a Korean and English chat model locally on a Mac. For app builders and local…
ornith-ai · Kit
Runs a 35B mixture-of-experts text model tuned for coding and agent work, using only about 3B parameters per token. This repository holds its GGUF files for lo…
google · Kit
Google's Gemma 4 12B Unified model, an open model that reads text, images, audio and video and writes text, with a 256K context and no separate encoders. For d…
unsloth · Kit
Runs Qwen3.6-35B-A3B, a mixture-of-experts model that reads images and text and uses about 3B parameters per token, from Unsloth GGUF files. For developers who…
openai · Kit
Writes, reasons and calls tools from text prompts, in an open-weight 21B model from OpenAI that runs within 16 GB of memory. For developers who want a local or…
lodestones · Kit
Cuts MOSS-Image-SFT image generation down to 8 steps with no CFG, shipped as LoRA files for ComfyUI. A work-in-progress distillation for people who generate im…
Cactus-Compute · Kit
Provides prebuilt runtime binaries that run text, speech and vision models locally on phones, laptops, servers and browsers. For developers who ship on-device…
DavidAU · Kit
Runs Qwen3.8-27B in GGUF form with a set of reasoning and instruct modes you switch from your prompt. For people who run local models and like to tune how the…
meta-models · Kit
Reads text and images and carries out agent tasks such as tool calls and multi-step reasoning on a local machine, in a 30B model distilled from Muse Spark. For…
AtomicChat · Kit
GGUF quantized files of the 65B Ripple Preview agentic-coding model, for running locally with llama.cpp. For people who run large open models on their own hard…
SyzygyResearch · Kit
Turns English text into speech on a single CPU core, using a 3.5-bit version of Gradium's Phonon 31m model that runs several times faster than real time, for d…
unsloth · Kit
Unsloth's GGUF quantizations of DeepSeek-V4.1-Flash-1017, a huge image-and-text model, for running locally on a machine with 128 GB or more of RAM. For people…
ISTA-DASLab · Kit
A coding-focused GGUF build of Qwen3.8-Flash-Next with half its experts removed, cutting 354 GB at BF16 to 58.4 GB while keeping image input. For people with l…