MiniCPM-V-4.7-1B-gguf
openbmb · Kit
Runs a 1B vision-language model through llama.cpp, answering text prompts about images. GGUF files in many quant sizes, for developers and hobbyists who want a…
New
AI skills and agents for developers
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Categories and filters
Listings
MiniCPM-OCR Jev GGUF
openbmb · Kit
Scores OCR readings of text, formula and table regions with a quality value between 0 and 1, in GGUF files for llama.cpp. For people who check OCR results on t…
New
Qwen3.5-0.8B-weight-space-programming-GGUF by NotCherry
NotCherry · Kit
Packages the Qwen3.5-0.8B weight-space-programming model as GGUF files for llama.cpp, with a 4-bit text model and a separate vision projector for image input.
New
Qwen3.8-27B-CodeForge-3xMerge i1 GGUF
mradermacher · Kit
Importance-matrix GGUF quants of the Qwen3.8-27B-CodeForge-3xMerge model, from about 11 GB to 22.5 GB, for local use. For people running 27B models on their ow…
New
Morphy1.1-Coder-Beta-7B-GGUF
moolvylabs · Kit
A 7.6B coding model from moolvylabs in GGUF form, released as a beta for testing and feedback. The card is short and gives no run steps, benchmarks or training…
New
Tess-4.5-27B GGUF
migtissera · Kit
GGUF builds of Tess-4.5, a 27B open-weights coding and agent model, for llama.cpp, with a vision projector and optional draft heads for faster generation. They…
New
Qwen3.6-35B-A3B lododo-Distill-v1.0 (GGUF)
lododoai · Kit
Runs as a local text model, a Qwen3.6-35B-A3B fine-tune trained on data written by Qwen3.8-27B and packed as one GGUF file for llama.cpp. For people who run mo…
New
Qwen3.8-27B-SLQ-GGUF
kaitchup · Kit
Compresses Qwen3.8-27B into three GGUF files with different size and fidelity levels, using a custom statistically lossless quantization. For people who run th…
New
Qwopus3.8-27B-Flash-V2-GGUF
Jackrong · Kit
Trims wasted reasoning in long agent tasks, as a GGUF build of the second Flash fine-tune of Qwen3.8-27B with better Python formatting. For people who run agen…
New
Ling-3.0-tiny-GGUF
inclusionAI · Kit
GGUF copy of inclusionAI's Ling-3.0-tiny, a small mixture-of-experts reasoning model with 7.9B total and 1.3B active parameters, for running locally at low cos…
New
K2-Horizon-7B-GGUF
IFM · Kit
Quantized GGUF copies of IFM's K2-Horizon-7B text model for running locally in llama.cpp, from BF16 down to 4-bit, with a 512K-token context window.
New
Qwen3.8-27B Intel Arc Tuned
Greatjedi · Kit
Runs a 27B Qwen3.8 model in GGUF files retuned for Intel Arc GPUs, with pure decode near 22 tokens a second in the author's tests. For people running llama.cpp…
New
phonon-31m English for audio.cpp
gradium · Kit
Speaks English text aloud on a CPU from a 31M text-to-speech model in GGUF form, for the audio.cpp runtime. Made for developers who want a small local voice mo…
New
Qwen3-Reranker-0.6B-Q8_0-GGUF
ggml-org · Kit
Ranks passages by relevance to a query, as an 8-bit GGUF copy of the Qwen3 0.6B reranker made with llama.cpp. For developers who want a small local reranker fo…
New
Laya-GGUF
ggml-org · Kit
Small 421M-parameter decision model in GGUF form that you serve locally and call through a systemone API. For developers who use llama.cpp tooling and want a c…
New
Kev-4B by ggml-org
ggml-org · Kit
Makes decisions through the /v1/systemone API of a llama server, from a GGUF copy of a 4.2B model. For developers who want a small local decision model.
New
gemma-4-E4B-it-GGUF by ggml-org
ggml-org · Kit
A GGUF-format copy of Google's gemma-4-E4B-it that you can run on your own computer with the Llama app or the llama serve command. For people who want Gemma ru…
New
gemma-4-12B-it GGUF
ggml-org · Kit
Runs Google's gemma-4-12B-it on your own computer as a GGUF file that ggml-org converted automatically, through the Llama app or the llama command. It suits pe…
New
DeepSeek-V4.1-Flash-1017 GGUF
ggml-org · Kit
GGUF files of DeepSeek's 748B V4.1 Flash 1017 model, converted by ggml-org with a vision file for images, for people with big-memory machines who run models th…
New
POCKET-35B-GGUF
FINAL-Bench · Kit
Runs a Korean-tuned 35B model on your own PC from GGUF files with llama.cpp, with a CPU-only path so no GPU is needed. For people who want a local language mod…
New
KVARK Sparkle 1.1 27B GGUF
Egzakta · Kit
Runs the 27B KVARK Sparkle 1.1 model from GGUF files in several sizes, with optional image input and speculative decoding. For people running models locally wi…
New
Kvark-Sparkle-1.0-27B-GGUF
Egzakta · Kit
GGUF files of KVARK Sparkle 1.0, a 27B vision-language model, for llama.cpp, Ollama and LM Studio, with the speculative-decoding head kept. For people running…
New
Qwen3.8 Flash Next Turbo Brilliance 50x GGUF
DavidAU · Kit
A GGUF build of Qwen3.8-Flash-Next by DavidAU with 27 reasoning modes, 27 instruct modes and 15 AI personas you switch on from the prompt. For people with larg…
New
GGUF fine-tune of a 27B Qwen model by DavidAU, with switchable instruct and reasoning modes and a built-in help system. Hugging Face lists it as image text to…
New
Answers questions and reads images with much shorter thinking. GGUF builds of a 27B Qwen 3.8 tune from DavidAU that aims to cut reasoning tokens while keeping…
New
Qwen3.8-27B iMatrix NVFP4 MTP GGUF
cdiamond · Kit
A 17.1 GB mixed-precision GGUF of Qwen3.8-27B that keeps its multi-token prediction layer, tuned for 256K context with vision on a 24 GB GPU. For people who ru…
New
Qwen3.6-35B-A3B MTP GGUF
byteshape · Kit
Runs Qwen3.6-35B-A3B from a GGUF quantization with Multi-Token Prediction for faster GPU decoding in llama.cpp. Made by ByteShape for people running local mode…
New
Meta-Llama-3.1-8B-Instruct-GGUF
bartowski · Kit
Quantized GGUF files of Meta's Llama 3.1 8B Instruct for local chat, such as 4.92 GB for Q4_K_M and 8.54 GB for Q8_0. Made by bartowski with an importance matr…
New
Llama-3.2-3B-Instruct-GGUF
bartowski · Kit
GGUF quantizations of Meta's Llama-3.2-3B-Instruct, made by bartowski with an importance matrix, from about 1.8 GB to 6.4 GB. For running a small chat model lo…
New
KAT-Coder-V2.5-Dev GGUF
bartowski · Kit
Imatrix GGUF quantizations of Kwaipilot's KAT-Coder-V2.5-Dev, a 34.7B text model, with 4-bit files of about 19 GB or more. For people who run a large coder-nam…
New
DeepSeek V4.1 Flash GGUF for DwarfStar
antirez · Kit
Gives Mac users calibrated 2-bit and 4-bit GGUF files of DeepSeek V4.1 Flash, plus a separate vision encoder, for DwarfStar's Metal engine with SSD streaming.…
New
Forge-1-Gemma-4-E2B
YoSaNoo · Kit
A small coding-minded text model fine-tuned from Google's gemma-4-E2B and shared as GGUF files, so you can run it on your own laptop in Ollama, LM Studio, Unsl…
New
Spark-X2.6-1.7B-DSpark-GGUF
XHToken · Kit
A small draft model that speeds up Spark-X2.6-1.7B through speculative decoding, guessing up to seven tokens per step. For people who run that model locally on…
New
Llama-3.2-1B-Instruct-GGUF
unsloth · Kit
Chats, summarizes and answers questions in text on a laptop, as Unsloth's GGUF copy of Meta's small Llama 3.2 1B Instruct in precisions from 16-bit to 2-bit. F…
New
GLM-4-9B-0414-GGUF
unsloth · Kit
Generates text in Chinese and English from GGUF files of the 9.4B GLM-4-9B-0414 model, for people who want to run a GLM model on their own computer.
New
gemma-4-E2B-it-GGUF
unsloth · Kit
Unsloth's GGUF files of Google DeepMind's Gemma 4 E2B instruction-tuned model, which takes text and images and writes text, with a 128K context. For people who…
New
gemma-3-4b-it-GGUF
unsloth · Kit
Answers questions about text and images on your own computer, as a GGUF copy of Google's Gemma 3 4B instruction model packaged by Unsloth. For developers and u…
New
OmniVoice GGUF
Serveurperso · Kit
Provides GGUF weights of the OmniVoice text-to-speech model for the omnivoice.cpp runtime, with voice design and voice cloning examples. For developers who wan…
New
gemma-4-31B-it-scotoma-2-GGUF
ReadyArt · Kit
Runs a 30.7B-parameter Gemma-based text model locally in GGUF format, packaged by ReadyArt from its gemma-4-31B-it-scotoma-2 model. Suits people who want that…
New
Qwen3-4B-GGUF
Qwen · Kit
A 4B chat model in GGUF format that runs locally in llama.cpp or ollama, with a thinking mode for reasoning and a plain mode for quick replies. Suits developer…
New
Qwen2.5-Coder-14B-Instruct-GGUF
Qwen · Kit
Gives you the Qwen2.5-Coder 14B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp. For developers who want a stronger lo…
New
Qwen2.5-Coder-1.5B-Instruct-GGUF
Qwen · Kit
Gives you the small Qwen2.5-Coder 1.5B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp on a laptop. For developers who…
New
Qwen3.5-4B-GLB-3D-Coder-GGUF
mradermacher · Kit
Static GGUF quantizations of ccore/Qwen3.5-4B-GLB-3D-Coder, a 4.2B model, in sizes from 2.0 GB to 8.5 GB, plus two small multi-modal supplement files. Made by…
New
AREX-2 GGUF
mradermacher · Kit
GGUF quantized files of BAAI's AREX-2, a 26.9B model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit people who run a large model local…
New
Kromoss GGUF
molbal · Kit
GGUF quantized copies of Kromoss, a 1024 px text-to-image model fine-tuned from MOSS-Image-Base, for ComfyUI. For artists who want to generate images on a GPU…
New
Mellum2.1-12B-A2.5B-Thinking-GGUF
JetBrains · Kit
Runs JetBrains' 12B reasoning model locally in llama.cpp, Ollama or LM Studio, with five GGUF sizes to pick from. For developers who want a thinking model with…
New
Axion-1.0-35B-APEX-I-MiniPlus-V2.1-GGUF
IsValorum · Kit
Runs the 35B Axion-1.0 model locally in llama.cpp from one compressed GGUF file with mixed precision. A quantized release by IsValorum for people who want a la…
New
gpt-oss-20b-GGUF by ggml-org
ggml-org · Kit
Generates text on your own computer from a GGUF copy of OpenAI's gpt-oss-20b, packaged by ggml-org. For people who want to run an open 20B model locally in the…
New
Qwen3.8-27B-Ridge-GGUF
empero-ai · Kit
Runs Qwen3.8-27B as a compact 3.7 bits-per-weight GGUF file that suits a 16 GB GPU, with optional image input. For people running models locally with llama.cpp…
New
Qwen3.6-35B-A3B 2-bit GSQ GGUF
chtisgit · Kit
Runs a 35B Qwen model in a 2-bit GSQ GGUF conversion with a separate vision projector for llama.cpp. For people who want a large model in a small file on CPU o…
New
Qwen3.6-35B-A3B GGUF (ShapeLearn Quantized)
byteshape · Kit
Quantized GGUF versions of Qwen3.6-35B-A3B that read images and text, with CPU and GPU variants from about 9 GB, made with ByteShape's ShapeLearn. For develope…
New
Spark-X2.6-4B GGUF
bartowski · Kit
Small English and Chinese chat model as GGUF files from full bf16 down to about 2.4 GB, for llama.cpp, with a low or high thinking setting. For developers who…
New
Qwen3.6-35B-A3B-coding-reap50-GGUF
anik-jha · Kit
Writes code with Qwen3.6-35B-A3B cut to half its experts and packed as GGUF files for llama.cpp. Made for developers who want a coding model that fits in less…
New
Spark-X2.6-4B-DSpark-GGUF
XHToken · Kit
Speeds up text generation for Spark-X2.6-4B as a small draft model for speculative decoding, in GGUF format. Meant for people running that model locally with l…
New
Qwen3.5-2B-GGUF
unsloth · Kit
Reads images and text and answers in text, as a small GGUF copy of Qwen3.5-2B by unsloth. Meant for local prototyping, fine-tuning and research.
New
Nanbeige4.3-33B-GGUF-UltraOptimised-Curated-Protium
SolsticeAI · Kit
Offers GGUF quantizations of the 33.1B Nanbeige4.3 model for llama.cpp and Ollama, with a reasoning protocol and up to 524,288 tokens of context. For developer…
New
Wan2.2 TI2V 5B GGUF
QuantStack · Kit
A 5B-parameter text-to-video model converted to GGUF for ComfyUI, about 2.5 GB at 4-bit by estimate, for English and Chinese prompts. It suits ComfyUI users wh…
New
Ornith-1.5-122B-GGUF by unsloth
unsloth · Kit
Runs the Ornith-1.5-122B text model on your own machine, as GGUF files made by unsloth. A 122B mixture-of-experts model aimed at coding and agent work on a sin…
New
Qwen2.5-1.5B-Instruct-GGUF
Qwen · Kit
Gives you the small Qwen2.5 1.5B chat model as GGUF files in eight quantization sizes, for running with llama.cpp on a laptop or modest GPU. For people who wan…
New
Qwen3.5-0.8B-weight-space-programming-GGUF
prithivMLmods · Kit
GGUF copies of a small Qwen3.5 0.8B model whose weights were edited directly to reduce reasoning loops. For people who want to run it locally in several quant…
New
Ornith-1.5-35B-A3B-GSQ-RCO-GGUF
pfeifferj · Kit
Shrinks the Ornith-1.5-35B-A3B text model to 3-bit and 3.5-bit GGUF files, about 13 and 15 GB instead of 69 GB, for people who run local models with llama.cpp.
New
DeepSeek-V4.1-Flash-1017 Maya GGUF
peasantsmith · Kit
Runs a 748B DeepSeek mixture-of-experts model on a home PC through two GGUF quantizations made for Project Maya. For people with a big-RAM machine and a fast S…
New
MiniCPM5-2B-GGUF
openbmb · Kit
Gives you MiniCPM5-2B, a small dense text model for English and Chinese, as GGUF files for on-device and local use. Suits people who want a compact model for c…
New
ttf-Qwen3.8-Flash-Next-GGUF
oguzeldereli · Kit
Runs Qwen3.8-Flash-Next, a 180B mixture-of-experts model squeezed to ternary weights, from one 40.4 GB GGUF file that is 4.6 times smaller than the FP8 release…
New
ttf-Qwen3.8-27B-GGUF
oguzeldereli · Kit
Runs Qwen3.8-27B squeezed to ternary weights as GGUF files that fit on a 12 GB GPU, in an 8.2 GB and a 6.74 GB variant. For people who want a large local model…
New
Hermes-3-Llama-3.1-8B-GGUF
NousResearch · Kit
Runs Hermes 3, an 8B general-purpose chat model from NousResearch, as a quantized GGUF file for llama.cpp. Suits people who want a local assistant with functio…
New
AREX-2-i1-GGUF
mradermacher · Kit
Weighted GGUF quantizations of BAAI/AREX-2, a 26.9B vision model, in about two dozen sizes from 7.2 GB to 22.2 GB, plus an imatrix file for making your own qua…
New
GGUF build of LiquidAI's LFM2.5-8B-A1B, a sparse mixture-of-experts model, with DavidAU's Turbo Brilliance system and 12 reasoning modes. An 8.5B beta-style re…
New
GGUF build of LiquidAI's LFM2.5-2.6B with DavidAU's Turbo Brilliance system, adding 12 reasoning and 12 instruct modes you switch in the prompt. A 2.7B beta fo…
New
Qwen3.8-27B-GGUF by bartowski
bartowski · Kit
A set of GGUF quantizations of Qwen3.8-27B by bartowski, from Q8_0 down to 3-bit, made with an importance matrix. For people running a 27B vision-language mode…
New
Jackrong_Qwopus3.8-27B-Coder-Flash-GGUF
bartowski · Kit
GGUF quantizations of Jackrong's Qwopus3.8-27B-Coder-Flash, made by bartowski with an importance matrix, in sizes from 17 GB to 55 GB. For running a 27B model…
New
Qwen3.5-9B-MTP-GGUF
unsloth · Kit
GGUF copies of Qwen3.5 9B that support multi-token-prediction speculative decoding in llama.cpp for faster generation. For people running the model locally who…
New
Qwen3.5-0.8B-GGUF
unsloth · Kit
Reads images and text and answers in text, as a small GGUF copy of Qwen3.5-0.8B by unsloth. Meant for local prototyping, fine-tuning and research.
New
gpt-oss-20b-GGUF
unsloth · Kit
Runs OpenAI's open-weight gpt-oss-20b reasoning model on your own computer, packed as GGUF files by unsloth. Suits developers who want a local model with adjus…
New
Qwen3.8-27B-1C
sweetand · Kit
Helps developers on the 1C:Enterprise platform by reading and fixing BSL code and finding objects in XML exports. A Russian-first fine-tune of Qwen3.8-27B, off…
New
Wan2.2-I2V-A14B-GGUF
QuantStack · Kit
Provides GGUF files of Wan2.2-I2V-A14B, a 14B model that turns a still image into a video, for use in ComfyUI with the ComfyUI-GGUF node. For people making sho…
New
Bonsai-27B-gguf
prism-ml · Kit
Runs a 27B-class reasoning model as a 1-bit GGUF file of about 3.9 GB for llama.cpp, so it fits a laptop or one GPU. For people who want local reasoning on eve…
New
Sharp-Spark-X2.5-4B-GGUF
peculiar-ragdoll · Kit
Compressed GGUF copies of the 4B Spark-X2.5 coding model, tuned for long context on GPUs with about 6 GB of memory. Made for developers who want a local coder…
New
Qwen3.8-27B-GGUF by lmstudio-community
lmstudio-community · Kit
A GGUF quantization of Qwen's Qwen3.8-27B made by the LM Studio team with llama.cpp, for people who run a 27B model on their own computer.
New
Raon-1 mini (GGUF)
KRAFTON · Kit
Runs a 28.8B mixture-of-experts model tuned for Korean chat, reasoning and tool-using agents in llama.cpp. GGUF copy of Raon-1 mini preview for people who run…
New
gemma-4-12B-it-qat-q4_0-gguf
google · Kit
Runs Google's Gemma 4 12B instruction-tuned model in a 4-bit GGUF file made with quantization-aware training. Reads text and images, and suits laptops and cons…
New
Qwen3.8-2B-Distill-GGUF
empero-ai · Kit
Runs a small 2B reasoning model on phones, laptops and single-board computers, as GGUF files in five quant levels. A distillation of a large Qwen3.8 model, pac…
New
Nanbeige_Nanbeige4.3-33B-GGUF
bartowski · Kit
GGUF quantizations of Nanbeige4.3-33B, made by bartowski with an importance matrix, from about 21 GB to 66 GB. For running a 33B English and Chinese text model…
New
Qwen2.5-VL-7B-Instruct-GGUF
unsloth · Kit
Unsloth's GGUF files of Qwen2.5-VL-7B-Instruct, a vision-language model that reads images, charts, documents and long videos and can output coordinates and str…
New
gemma-4-E4B-it-GGUF
unsloth · Kit
A 4-bit GGUF copy of Google's Gemma 4 E4B instruction model, packaged by Unsloth for running on your own machine. It reads text and images and answers in text.
New
gemma-4-12b-it-GGUF
unsloth · Kit
Unsloth's GGUF quantized copy of Google's instruction-tuned Gemma 4 12B, a model that takes text, images, audio and video and writes text, for running locally.
New
embeddinggemma-2-GGUF
unsloth · Kit
Turns text into 768-dimensional vectors for on-device search, retrieval and clustering. The base model also covers images, video and audio. Packaged as GGUF by…
New
Qwen3.8-27B-GGUF by ggml-org
ggml-org · Kit
Runs Qwen3.8-27B, a 26.9B model that takes images and text and replies in text, as a GGUF file for local use through the llama tools. Made for people who want…
New
Qwen3.8-4B-Distill-GGUF
empero-ai · Kit
Runs a 4B reasoning model on a laptop or a mid-range graphics card, as GGUF files in five quant levels. A distillation of a large Qwen3.8 model, packaged by Em…
New
Spark-X2.6-1.7B-GGUF
XHToken · Kit
Runs a small 1.7B on-device language model from XHToken as 4-bit GGUF files, for chat, coding and agent tasks in English and Chinese, with adjustable thinking…
New
gemma-4-12B-it-qat-GGUF
unsloth · Kit
Gemma 4 12B in GGUF form, trained with quantization-aware training so a 4-bit copy keeps near-bfloat16 quality. For people running Gemma locally with llama.cpp…
New
Qwen3.5-4B-3D-Coder-MTP-Repacked
prithivMLmods · Kit
A repacked copy of ccore's Qwen3.5-4B-3D-Coder, a small model tuned to write coding answers and Three.js 3D scenes, with GGUF files that support multi-token pr…
New
GLM-5.3-Flash-Coder-RCO-152E-GGUF
lapadatbogdan · Kit
Runs a pruned GLM-5.3-Flash coding and agent model on a home PC, as GGUF files in five quant sizes. It keeps 152 of 288 experts per layer, cutting a 321B model…
New
gemma-4-31B-it-GGUF
unsloth · Kit
Runs Google's Gemma 4 31B instruction-tuned model locally from Unsloth's GGUF files, with text and image input and a long context. Suits developers who want a…
New
Idol-GGUF
TimeLordRaps · Kit
An 8-bit GGUF build of SperiD Labs' Idol that turns one image into a 3D Gaussian point cloud and a mesh, run locally with idol.cpp. For developers working on i…
New
Qwen3-8B-GGUF
Qwen · Kit
Runs Qwen3-8B as quantized GGUF files in llama.cpp or Ollama, with a thinking mode for math, code and logic and a plain mode for chat. For people who want a lo…
New
GLM-5.3-Flash Maya GGUF
peasantsmith · Kit
Five GGUF compressions of GLM-5.3-Flash, a 321B mixture-of-experts model, sized from 73.4 GB to 156.3 GB for Project Maya, which spreads the model across GPU,…
New
Qwen3.8-9B-Distill-GGUF
empero-ai · Kit
GGUF quantizations of Empero's Qwen3.8-9B, a reasoning model distilled from a larger Qwen3.8 into the Qwen3.5-9B design, for llama.cpp, Ollama, LM Studio and s…
New
ZONOS3-Mini GGUF
AtomicChat · Kit
Packs the ZONOS3-Mini text-to-speech model as GGUF files for llama.cpp, with 27 built-in voices and six backbone sizes from 0.41 to 1.61 GB. For developers run…
New
Gemma4-12B v2 Coding + Agentic Edition
yuxinlu1 · Kit
A GGUF fine-tune of Google's Gemma 4 12B instruction model for coding and tool-using agent work, sized to run offline on a machine with about 4.5 GB of free me…
New