Qwen3.6-35B-A3B 2-bit GSQ GGUF
chtisgit · Kit
Runs a 35B Qwen model in a 2-bit GSQ GGUF conversion with a separate vision projector for llama.cpp. For people who want a large model in a small file on CPU o…
New
AI skills and agents for developers
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Categories and filters
Listings
Qwen3.6-35B-A3B GGUF (ShapeLearn Quantized)
byteshape · Kit
Quantized GGUF versions of Qwen3.6-35B-A3B that read images and text, with CPU and GPU variants from about 9 GB, made with ByteShape's ShapeLearn. For develope…
New
Spark-X2.6-4B GGUF
bartowski · Kit
Small English and Chinese chat model as GGUF files from full bf16 down to about 2.4 GB, for llama.cpp, with a low or high thinking setting. For developers who…
New
Qwen3.6-35B-A3B-coding-reap50-GGUF
anik-jha · Kit
Writes code with Qwen3.6-35B-A3B cut to half its experts and packed as GGUF files for llama.cpp. Made for developers who want a coding model that fits in less…
New
Spark-X2.6-4B-DSpark-GGUF
XHToken · Kit
Speeds up text generation for Spark-X2.6-4B as a small draft model for speculative decoding, in GGUF format. Meant for people running that model locally with l…
New
Qwen3.5-2B-GGUF
unsloth · Kit
Reads images and text and answers in text, as a small GGUF copy of Qwen3.5-2B by unsloth. Meant for local prototyping, fine-tuning and research.
New
Nanbeige4.3-33B-GGUF-UltraOptimised-Curated-Protium
SolsticeAI · Kit
Offers GGUF quantizations of the 33.1B Nanbeige4.3 model for llama.cpp and Ollama, with a reasoning protocol and up to 524,288 tokens of context. For developer…
New
Wan2.2 TI2V 5B GGUF
QuantStack · Kit
A 5B-parameter text-to-video model converted to GGUF for ComfyUI, about 2.5 GB at 4-bit by estimate, for English and Chinese prompts. It suits ComfyUI users wh…
New
Ornith-1.5-122B-GGUF by unsloth
unsloth · Kit
Runs the Ornith-1.5-122B text model on your own machine, as GGUF files made by unsloth. A 122B mixture-of-experts model aimed at coding and agent work on a sin…
New
Qwen2.5-1.5B-Instruct-GGUF
Qwen · Kit
Gives you the small Qwen2.5 1.5B chat model as GGUF files in eight quantization sizes, for running with llama.cpp on a laptop or modest GPU. For people who wan…
New
Qwen3.5-0.8B-weight-space-programming-GGUF
prithivMLmods · Kit
GGUF copies of a small Qwen3.5 0.8B model whose weights were edited directly to reduce reasoning loops. For people who want to run it locally in several quant…
New
Ornith-1.5-35B-A3B-GSQ-RCO-GGUF
pfeifferj · Kit
Shrinks the Ornith-1.5-35B-A3B text model to 3-bit and 3.5-bit GGUF files, about 13 and 15 GB instead of 69 GB, for people who run local models with llama.cpp.
New
DeepSeek-V4.1-Flash-1017 Maya GGUF
peasantsmith · Kit
Runs a 748B DeepSeek mixture-of-experts model on a home PC through two GGUF quantizations made for Project Maya. For people with a big-RAM machine and a fast S…
New
MiniCPM5-2B-GGUF
openbmb · Kit
Gives you MiniCPM5-2B, a small dense text model for English and Chinese, as GGUF files for on-device and local use. Suits people who want a compact model for c…
New
ttf-Qwen3.8-Flash-Next-GGUF
oguzeldereli · Kit
Runs Qwen3.8-Flash-Next, a 180B mixture-of-experts model squeezed to ternary weights, from one 40.4 GB GGUF file that is 4.6 times smaller than the FP8 release…
New
ttf-Qwen3.8-27B-GGUF
oguzeldereli · Kit
Runs Qwen3.8-27B squeezed to ternary weights as GGUF files that fit on a 12 GB GPU, in an 8.2 GB and a 6.74 GB variant. For people who want a large local model…
New
Hermes-3-Llama-3.1-8B-GGUF
NousResearch · Kit
Runs Hermes 3, an 8B general-purpose chat model from NousResearch, as a quantized GGUF file for llama.cpp. Suits people who want a local assistant with functio…
New
AREX-2-i1-GGUF
mradermacher · Kit
Weighted GGUF quantizations of BAAI/AREX-2, a 26.9B vision model, in about two dozen sizes from 7.2 GB to 22.2 GB, plus an imatrix file for making your own qua…
New
GGUF build of LiquidAI's LFM2.5-8B-A1B, a sparse mixture-of-experts model, with DavidAU's Turbo Brilliance system and 12 reasoning modes. An 8.5B beta-style re…
New
GGUF build of LiquidAI's LFM2.5-2.6B with DavidAU's Turbo Brilliance system, adding 12 reasoning and 12 instruct modes you switch in the prompt. A 2.7B beta fo…
New
Qwen3.8-27B-GGUF by bartowski
bartowski · Kit
A set of GGUF quantizations of Qwen3.8-27B by bartowski, from Q8_0 down to 3-bit, made with an importance matrix. For people running a 27B vision-language mode…
New
Jackrong_Qwopus3.8-27B-Coder-Flash-GGUF
bartowski · Kit
GGUF quantizations of Jackrong's Qwopus3.8-27B-Coder-Flash, made by bartowski with an importance matrix, in sizes from 17 GB to 55 GB. For running a 27B model…
New
Qwen3.5-9B-MTP-GGUF
unsloth · Kit
GGUF copies of Qwen3.5 9B that support multi-token-prediction speculative decoding in llama.cpp for faster generation. For people running the model locally who…
New
Qwen3.5-0.8B-GGUF
unsloth · Kit
Reads images and text and answers in text, as a small GGUF copy of Qwen3.5-0.8B by unsloth. Meant for local prototyping, fine-tuning and research.
New
gpt-oss-20b-GGUF
unsloth · Kit
Runs OpenAI's open-weight gpt-oss-20b reasoning model on your own computer, packed as GGUF files by unsloth. Suits developers who want a local model with adjus…
New
Qwen3.8-27B-1C
sweetand · Kit
Helps developers on the 1C:Enterprise platform by reading and fixing BSL code and finding objects in XML exports. A Russian-first fine-tune of Qwen3.8-27B, off…
New
Wan2.2-I2V-A14B-GGUF
QuantStack · Kit
Provides GGUF files of Wan2.2-I2V-A14B, a 14B model that turns a still image into a video, for use in ComfyUI with the ComfyUI-GGUF node. For people making sho…
New
Bonsai-27B-gguf
prism-ml · Kit
Runs a 27B-class reasoning model as a 1-bit GGUF file of about 3.9 GB for llama.cpp, so it fits a laptop or one GPU. For people who want local reasoning on eve…
New
Sharp-Spark-X2.5-4B-GGUF
peculiar-ragdoll · Kit
Compressed GGUF copies of the 4B Spark-X2.5 coding model, tuned for long context on GPUs with about 6 GB of memory. Made for developers who want a local coder…
New
Qwen3.8-27B-GGUF by lmstudio-community
lmstudio-community · Kit
A GGUF quantization of Qwen's Qwen3.8-27B made by the LM Studio team with llama.cpp, for people who run a 27B model on their own computer.
New
Raon-1 mini (GGUF)
KRAFTON · Kit
Runs a 28.8B mixture-of-experts model tuned for Korean chat, reasoning and tool-using agents in llama.cpp. GGUF copy of Raon-1 mini preview for people who run…
New
gemma-4-12B-it-qat-q4_0-gguf
google · Kit
Runs Google's Gemma 4 12B instruction-tuned model in a 4-bit GGUF file made with quantization-aware training. Reads text and images, and suits laptops and cons…
New
Qwen3.8-2B-Distill-GGUF
empero-ai · Kit
Runs a small 2B reasoning model on phones, laptops and single-board computers, as GGUF files in five quant levels. A distillation of a large Qwen3.8 model, pac…
New
Nanbeige_Nanbeige4.3-33B-GGUF
bartowski · Kit
GGUF quantizations of Nanbeige4.3-33B, made by bartowski with an importance matrix, from about 21 GB to 66 GB. For running a 33B English and Chinese text model…
New
Qwen2.5-VL-7B-Instruct-GGUF
unsloth · Kit
Unsloth's GGUF files of Qwen2.5-VL-7B-Instruct, a vision-language model that reads images, charts, documents and long videos and can output coordinates and str…
New
gemma-4-E4B-it-GGUF
unsloth · Kit
A 4-bit GGUF copy of Google's Gemma 4 E4B instruction model, packaged by Unsloth for running on your own machine. It reads text and images and answers in text.
New
gemma-4-12b-it-GGUF
unsloth · Kit
Unsloth's GGUF quantized copy of Google's instruction-tuned Gemma 4 12B, a model that takes text, images, audio and video and writes text, for running locally.
New
embeddinggemma-2-GGUF
unsloth · Kit
Turns text into 768-dimensional vectors for on-device search, retrieval and clustering. The base model also covers images, video and audio. Packaged as GGUF by…
New
Qwen3.8-27B-GGUF by ggml-org
ggml-org · Kit
Runs Qwen3.8-27B, a 26.9B model that takes images and text and replies in text, as a GGUF file for local use through the llama tools. Made for people who want…
New
Qwen3.8-4B-Distill-GGUF
empero-ai · Kit
Runs a 4B reasoning model on a laptop or a mid-range graphics card, as GGUF files in five quant levels. A distillation of a large Qwen3.8 model, packaged by Em…
New
Spark-X2.6-1.7B-GGUF
XHToken · Kit
Runs a small 1.7B on-device language model from XHToken as 4-bit GGUF files, for chat, coding and agent tasks in English and Chinese, with adjustable thinking…
New
gemma-4-12B-it-qat-GGUF
unsloth · Kit
Gemma 4 12B in GGUF form, trained with quantization-aware training so a 4-bit copy keeps near-bfloat16 quality. For people running Gemma locally with llama.cpp…
New
Qwen3.5-4B-3D-Coder-MTP-Repacked
prithivMLmods · Kit
A repacked copy of ccore's Qwen3.5-4B-3D-Coder, a small model tuned to write coding answers and Three.js 3D scenes, with GGUF files that support multi-token pr…
New
GLM-5.3-Flash-Coder-RCO-152E-GGUF
lapadatbogdan · Kit
Runs a pruned GLM-5.3-Flash coding and agent model on a home PC, as GGUF files in five quant sizes. It keeps 152 of 288 experts per layer, cutting a 321B model…
New
gemma-4-31B-it-GGUF
unsloth · Kit
Runs Google's Gemma 4 31B instruction-tuned model locally from Unsloth's GGUF files, with text and image input and a long context. Suits developers who want a…
New
Idol-GGUF
TimeLordRaps · Kit
An 8-bit GGUF build of SperiD Labs' Idol that turns one image into a 3D Gaussian point cloud and a mesh, run locally with idol.cpp. For developers working on i…
New
Qwen3-8B-GGUF
Qwen · Kit
Runs Qwen3-8B as quantized GGUF files in llama.cpp or Ollama, with a thinking mode for math, code and logic and a plain mode for chat. For people who want a lo…
New
GLM-5.3-Flash Maya GGUF
peasantsmith · Kit
Five GGUF compressions of GLM-5.3-Flash, a 321B mixture-of-experts model, sized from 73.4 GB to 156.3 GB for Project Maya, which spreads the model across GPU,…
New
Qwen3.8-9B-Distill-GGUF
empero-ai · Kit
GGUF quantizations of Empero's Qwen3.8-9B, a reasoning model distilled from a larger Qwen3.8 into the Qwen3.5-9B design, for llama.cpp, Ollama, LM Studio and s…
New
ZONOS3-Mini GGUF
AtomicChat · Kit
Packs the ZONOS3-Mini text-to-speech model as GGUF files for llama.cpp, with 27 built-in voices and six backbone sizes from 0.41 to 1.61 GB. For developers run…
New