Strata-Sage-A1.5-GGUF
ykarout · Kit
A Q4_K_M GGUF of the 35B Sage-A1.5 model made for the Strata inference engine, fitting a full 262K context on a 16 GB graphics card plus 64 GB of RAM. For peop…
New
Kits of AI agent skills, rules and prompts
Categories and filters
Listings
OpenBonsai Qwen3.5-9B Ternary
webbrain-one · Kit
Runs Qwen3.5-9B squeezed to ternary weights in a roughly 2 GB GGUF file, for CPU use in two llama.cpp variants. A research preview for people who experiment wi…
New
Granite Speech 5.0 TurboCTC 470M GGUF
vladers · Kit
Converts speech to text in seven languages, as quantized GGUF versions of IBM's Granite Speech 5.0 TurboCTC 470M, built for transcribe.cpp. For developers addi…
New
Z-Image-Turbo-GGUF by unsloth
unsloth · Kit
Unsloth's GGUF files of Z-Image-Turbo, a fast distilled text-to-image model that the authors say fits on a 16 GB consumer GPU. For people who generate images l…
New
Qwen3.6-27B-MTP-GGUF
unsloth · Kit
Codes and reasons with Qwen3.6 27B in GGUF files by Unsloth that carry multi-token prediction, which the card says speeds up replies about 1.5 to 2 times with…
New
Qwen3.5-0.8B-MTP-GGUF
unsloth · Kit
Runs the small Qwen3.5 0.8B vision-language model in llama.cpp with multi-token prediction for faster generation, as Unsloth's GGUF files. For developers testi…
New
Muse Glimmer 30B GGUF
unsloth · Kit
Runs a 30B agent model locally that reads text and images, calls tools and retries failed calls, from Unsloth's GGUF files. For developers building local agent…
New
granite-4.1-8b-GGUF
unsloth · Kit
Follows instructions, calls tools and chats with IBM's Granite 4.1 8B model, in GGUF files by Unsloth that include chat template fixes. Made for business assis…
New
gemma-4-31B-it-qat-GGUF
unsloth · Kit
Runs Google's Gemma 4 31B instruction model from Unsloth's 4-bit QAT GGUF files, with an included drafter for faster speculative decoding in llama.cpp. For peo…
New
YuE2-GGUF
Serveurperso · Kit
Pre-quantized GGUF files for yue2.cpp, a C++ song generator that turns style tags and lyrics into stereo audio plus the score it composed. For musicians and ti…
New
Haas-ja-v1.0-GGUF
sakasegawa · Kit
GGUF files of a Japanese speech recognition model that run only in speech.cpp, on macOS, Windows, Linux or the CPU alone. For people who transcribe Japanese au…
New
Flint NVFP4 GGUF
RecursiveSI · Kit
A 4-bit NVFP4 copy of the Recursive Flint text model as one GGUF file, built for NVIDIA GPUs through llama.cpp. For developers running a large local model with…
New
Qwen3-Embedding-0.6B-GGUF
Qwen · Kit
Turns text into number vectors for search, retrieval and clustering in more than 100 languages, as a 0.6B model in GGUF format. Suits developers building searc…
New
Qwen3-1.7B-GGUF
Qwen · Kit
Gives you the small Qwen3 1.7B chat model as a q8_0 GGUF file for llama.cpp, with a switch between thinking and non-thinking replies. For people who want a lig…
New
Xiaomi-OCR-0-GGUF
prithivMLmods · Kit
Provides GGUF files of Xiaomi-OCR-0, a compact 0.8B vision-language model for reading documents and text in images, in sizes from about 466 MB to 1.52 GB. For…
New
Bonsai-1.7B-GGUF
prism-ml · Kit
Generates text with a 1.7B language model packed to 1 bit per weight, about 0.24 GB, for llama.cpp on CUDA, Metal and CPU. For developers who need a tiny local…
New
Qwen3.8-27B-QSA-GSQ-RCO-GGUF
pentacoxian-dev · Kit
Runs Qwen3.8-27B with sparse attention on a single 24 GB GPU at a 262K-token context with image input, as GGUF files for people with a custom llama.cpp engine…
New
Ornith-1.0-9B-GGUF
ornith-ai · Kit
GGUF copy of a 9B open-source coding-agent model, trained with reinforcement learning to write solutions and the scaffolding around them. Built for single-GPU…
New
MiniCPM-V-4.7-1B-gguf
openbmb · Kit
Runs a 1B vision-language model through llama.cpp, answering text prompts about images. GGUF files in many quant sizes, for developers and hobbyists who want a…
New
MiniCPM-OCR Jev GGUF
openbmb · Kit
Scores OCR readings of text, formula and table regions with a quality value between 0 and 1, in GGUF files for llama.cpp. For people who check OCR results on t…
New
Qwen3.5-0.8B-weight-space-programming-GGUF by NotCherry
NotCherry · Kit
Packages the Qwen3.5-0.8B weight-space-programming model as GGUF files for llama.cpp, with a 4-bit text model and a separate vision projector for image input.
New
Qwen3.8-27B-CodeForge-3xMerge i1 GGUF
mradermacher · Kit
Importance-matrix GGUF quants of the Qwen3.8-27B-CodeForge-3xMerge model, from about 11 GB to 22.5 GB, for local use. For people running 27B models on their ow…
New
Morphy1.1-Coder-Beta-7B-GGUF
moolvylabs · Kit
A 7.6B coding model from moolvylabs in GGUF form, released as a beta for testing and feedback. The card is short and gives no run steps, benchmarks or training…
New
Tess-4.5-27B GGUF
migtissera · Kit
GGUF builds of Tess-4.5, a 27B open-weights coding and agent model, for llama.cpp, with a vision projector and optional draft heads for faster generation. They…
New
Qwen3.6-35B-A3B lododo-Distill-v1.0 (GGUF)
lododoai · Kit
Runs as a local text model, a Qwen3.6-35B-A3B fine-tune trained on data written by Qwen3.8-27B and packed as one GGUF file for llama.cpp. For people who run mo…
New
Qwen3.8-27B-SLQ-GGUF
kaitchup · Kit
Compresses Qwen3.8-27B into three GGUF files with different size and fidelity levels, using a custom statistically lossless quantization. For people who run th…
New
Qwopus3.8-27B-Flash-V2-GGUF
Jackrong · Kit
Trims wasted reasoning in long agent tasks, as a GGUF build of the second Flash fine-tune of Qwen3.8-27B with better Python formatting. For people who run agen…
New
Ling-3.0-tiny-GGUF
inclusionAI · Kit
GGUF copy of inclusionAI's Ling-3.0-tiny, a small mixture-of-experts reasoning model with 7.9B total and 1.3B active parameters, for running locally at low cos…
New
K2-Horizon-7B-GGUF
IFM · Kit
Quantized GGUF copies of IFM's K2-Horizon-7B text model for running locally in llama.cpp, from BF16 down to 4-bit, with a 512K-token context window.
New
Qwen3.8-27B Intel Arc Tuned
Greatjedi · Kit
Runs a 27B Qwen3.8 model in GGUF files retuned for Intel Arc GPUs, with pure decode near 22 tokens a second in the author's tests. For people running llama.cpp…
New
phonon-31m English for audio.cpp
gradium · Kit
Speaks English text aloud on a CPU from a 31M text-to-speech model in GGUF form, for the audio.cpp runtime. Made for developers who want a small local voice mo…
New
Qwen3-Reranker-0.6B-Q8_0-GGUF
ggml-org · Kit
Ranks passages by relevance to a query, as an 8-bit GGUF copy of the Qwen3 0.6B reranker made with llama.cpp. For developers who want a small local reranker fo…
New
Laya-GGUF
ggml-org · Kit
Small 421M-parameter decision model in GGUF form that you serve locally and call through a systemone API. For developers who use llama.cpp tooling and want a c…
New
Kev-4B by ggml-org
ggml-org · Kit
Makes decisions through the /v1/systemone API of a llama server, from a GGUF copy of a 4.2B model. For developers who want a small local decision model.
New
gemma-4-E4B-it-GGUF by ggml-org
ggml-org · Kit
A GGUF-format copy of Google's gemma-4-E4B-it that you can run on your own computer with the Llama app or the llama serve command. For people who want Gemma ru…
New
gemma-4-12B-it GGUF
ggml-org · Kit
Runs Google's gemma-4-12B-it on your own computer as a GGUF file that ggml-org converted automatically, through the Llama app or the llama command. It suits pe…
New
DeepSeek-V4.1-Flash-1017 GGUF
ggml-org · Kit
GGUF files of DeepSeek's 748B V4.1 Flash 1017 model, converted by ggml-org with a vision file for images, for people with big-memory machines who run models th…
New
POCKET-35B-GGUF
FINAL-Bench · Kit
Runs a Korean-tuned 35B model on your own PC from GGUF files with llama.cpp, with a CPU-only path so no GPU is needed. For people who want a local language mod…
New
KVARK Sparkle 1.1 27B GGUF
Egzakta · Kit
Runs the 27B KVARK Sparkle 1.1 model from GGUF files in several sizes, with optional image input and speculative decoding. For people running models locally wi…
New
Kvark-Sparkle-1.0-27B-GGUF
Egzakta · Kit
GGUF files of KVARK Sparkle 1.0, a 27B vision-language model, for llama.cpp, Ollama and LM Studio, with the speculative-decoding head kept. For people running…
New
Qwen3.8 Flash Next Turbo Brilliance 50x GGUF
DavidAU · Kit
A GGUF build of Qwen3.8-Flash-Next by DavidAU with 27 reasoning modes, 27 instruct modes and 15 AI personas you switch on from the prompt. For people with larg…
New
GGUF fine-tune of a 27B Qwen model by DavidAU, with switchable instruct and reasoning modes and a built-in help system. Hugging Face lists it as image text to…
New
Answers questions and reads images with much shorter thinking. GGUF builds of a 27B Qwen 3.8 tune from DavidAU that aims to cut reasoning tokens while keeping…
New
Qwen3.8-27B iMatrix NVFP4 MTP GGUF
cdiamond · Kit
A 17.1 GB mixed-precision GGUF of Qwen3.8-27B that keeps its multi-token prediction layer, tuned for 256K context with vision on a 24 GB GPU. For people who ru…
New
Qwen3.6-35B-A3B MTP GGUF
byteshape · Kit
Runs Qwen3.6-35B-A3B from a GGUF quantization with Multi-Token Prediction for faster GPU decoding in llama.cpp. Made by ByteShape for people running local mode…
New
Meta-Llama-3.1-8B-Instruct-GGUF
bartowski · Kit
Quantized GGUF files of Meta's Llama 3.1 8B Instruct for local chat, such as 4.92 GB for Q4_K_M and 8.54 GB for Q8_0. Made by bartowski with an importance matr…
New
Llama-3.2-3B-Instruct-GGUF
bartowski · Kit
GGUF quantizations of Meta's Llama-3.2-3B-Instruct, made by bartowski with an importance matrix, from about 1.8 GB to 6.4 GB. For running a small chat model lo…
New
KAT-Coder-V2.5-Dev GGUF
bartowski · Kit
Imatrix GGUF quantizations of Kwaipilot's KAT-Coder-V2.5-Dev, a 34.7B text model, with 4-bit files of about 19 GB or more. For people who run a large coder-nam…
New
DeepSeek V4.1 Flash GGUF for DwarfStar
antirez · Kit
Gives Mac users calibrated 2-bit and 4-bit GGUF files of DeepSeek V4.1 Flash, plus a separate vision encoder, for DwarfStar's Metal engine with SSD streaming.…
New
Forge-1-Gemma-4-E2B
YoSaNoo · Kit
A small coding-minded text model fine-tuned from Google's gemma-4-E2B and shared as GGUF files, so you can run it on your own laptop in Ollama, LM Studio, Unsl…
New
Spark-X2.6-1.7B-DSpark-GGUF
XHToken · Kit
A small draft model that speeds up Spark-X2.6-1.7B through speculative decoding, guessing up to seven tokens per step. For people who run that model locally on…
New
Llama-3.2-1B-Instruct-GGUF
unsloth · Kit
Chats, summarizes and answers questions in text on a laptop, as Unsloth's GGUF copy of Meta's small Llama 3.2 1B Instruct in precisions from 16-bit to 2-bit. F…
New
GLM-4-9B-0414-GGUF
unsloth · Kit
Generates text in Chinese and English from GGUF files of the 9.4B GLM-4-9B-0414 model, for people who want to run a GLM model on their own computer.
New
gemma-4-E2B-it-GGUF
unsloth · Kit
Unsloth's GGUF files of Google DeepMind's Gemma 4 E2B instruction-tuned model, which takes text and images and writes text, with a 128K context. For people who…
New
gemma-3-4b-it-GGUF
unsloth · Kit
Answers questions about text and images on your own computer, as a GGUF copy of Google's Gemma 3 4B instruction model packaged by Unsloth. For developers and u…
New
OmniVoice GGUF
Serveurperso · Kit
Provides GGUF weights of the OmniVoice text-to-speech model for the omnivoice.cpp runtime, with voice design and voice cloning examples. For developers who wan…
New
gemma-4-31B-it-scotoma-2-GGUF
ReadyArt · Kit
Runs a 30.7B-parameter Gemma-based text model locally in GGUF format, packaged by ReadyArt from its gemma-4-31B-it-scotoma-2 model. Suits people who want that…
New
Qwen3-4B-GGUF
Qwen · Kit
A 4B chat model in GGUF format that runs locally in llama.cpp or ollama, with a thinking mode for reasoning and a plain mode for quick replies. Suits developer…
New
Qwen2.5-Coder-14B-Instruct-GGUF
Qwen · Kit
Gives you the Qwen2.5-Coder 14B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp. For developers who want a stronger lo…
New
Qwen2.5-Coder-1.5B-Instruct-GGUF
Qwen · Kit
Gives you the small Qwen2.5-Coder 1.5B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp on a laptop. For developers who…
New
Qwen3.5-4B-GLB-3D-Coder-GGUF
mradermacher · Kit
Static GGUF quantizations of ccore/Qwen3.5-4B-GLB-3D-Coder, a 4.2B model, in sizes from 2.0 GB to 8.5 GB, plus two small multi-modal supplement files. Made by…
New
AREX-2 GGUF
mradermacher · Kit
GGUF quantized files of BAAI's AREX-2, a 26.9B model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit people who run a large model local…
New
Kromoss GGUF
molbal · Kit
GGUF quantized copies of Kromoss, a 1024 px text-to-image model fine-tuned from MOSS-Image-Base, for ComfyUI. For artists who want to generate images on a GPU…
New
Mellum2.1-12B-A2.5B-Thinking-GGUF
JetBrains · Kit
Runs JetBrains' 12B reasoning model locally in llama.cpp, Ollama or LM Studio, with five GGUF sizes to pick from. For developers who want a thinking model with…
New
Axion-1.0-35B-APEX-I-MiniPlus-V2.1-GGUF
IsValorum · Kit
Runs the 35B Axion-1.0 model locally in llama.cpp from one compressed GGUF file with mixed precision. A quantized release by IsValorum for people who want a la…
New
parakeet-ultra-gguf
handy-computer · Kit
Transcribes recordings in 25 European languages offline, using GGUF copies of Moondream's parakeet-ultra for transcribe.cpp. For people who want local speech-t…
New
gpt-oss-20b-GGUF by ggml-org
ggml-org · Kit
Generates text on your own computer from a GGUF copy of OpenAI's gpt-oss-20b, packaged by ggml-org. For people who want to run an open 20B model locally in the…
New
Qwen3.8-27B-Ridge-GGUF
empero-ai · Kit
Runs Qwen3.8-27B as a compact 3.7 bits-per-weight GGUF file that suits a 16 GB GPU, with optional image input. For people running models locally with llama.cpp…
New
Qwen3.6-35B-A3B 2-bit GSQ GGUF
chtisgit · Kit
Runs a 35B Qwen model in a 2-bit GSQ GGUF conversion with a separate vision projector for llama.cpp. For people who want a large model in a small file on CPU o…
New
Qwen3.6-35B-A3B GGUF (ShapeLearn Quantized)
byteshape · Kit
Quantized GGUF versions of Qwen3.6-35B-A3B that read images and text, with CPU and GPU variants from about 9 GB, made with ByteShape's ShapeLearn. For develope…
New
Spark-X2.6-4B GGUF
bartowski · Kit
Small English and Chinese chat model as GGUF files from full bf16 down to about 2.4 GB, for llama.cpp, with a low or high thinking setting. For developers who…
New
Qwen3.6-35B-A3B-coding-reap50-GGUF
anik-jha · Kit
Writes code with Qwen3.6-35B-A3B cut to half its experts and packed as GGUF files for llama.cpp. Made for developers who want a coding model that fits in less…
New
Spark-X2.6-4B-DSpark-GGUF
XHToken · Kit
Speeds up text generation for Spark-X2.6-4B as a small draft model for speculative decoding, in GGUF format. Meant for people running that model locally with l…
New
Qwen3.5-2B-GGUF
unsloth · Kit
Reads images and text and answers in text, as a small GGUF copy of Qwen3.5-2B by unsloth. Meant for local prototyping, fine-tuning and research.
New
MOSS-Image-SFT-GGUF
unsloth · Kit
Runs the MOSS-Image text to image model from compressed GGUF files on CPU, Mac or GPU, through Unsloth Studio or stable-diffusion.cpp. For people who make imag…
New
Nanbeige4.3-33B-GGUF-UltraOptimised-Curated-Protium
SolsticeAI · Kit
Offers GGUF quantizations of the 33.1B Nanbeige4.3 model for llama.cpp and Ollama, with a reasoning protocol and up to 524,288 tokens of context. For developer…
New
Wan2.2 TI2V 5B GGUF
QuantStack · Kit
A 5B-parameter text-to-video model converted to GGUF for ComfyUI, about 2.5 GB at 4-bit by estimate, for English and Chinese prompts. It suits ComfyUI users wh…
New
Ornith-1.5-122B-GGUF by unsloth
unsloth · Kit
Runs the Ornith-1.5-122B text model on your own machine, as GGUF files made by unsloth. A 122B mixture-of-experts model aimed at coding and agent work on a sin…
New
Qwen2.5-1.5B-Instruct-GGUF
Qwen · Kit
Gives you the small Qwen2.5 1.5B chat model as GGUF files in eight quantization sizes, for running with llama.cpp on a laptop or modest GPU. For people who wan…
New
Qwen3.5-0.8B-weight-space-programming-GGUF
prithivMLmods · Kit
GGUF copies of a small Qwen3.5 0.8B model whose weights were edited directly to reduce reasoning loops. For people who want to run it locally in several quant…
New
Ornith-1.5-35B-A3B-GSQ-RCO-GGUF
pfeifferj · Kit
Shrinks the Ornith-1.5-35B-A3B text model to 3-bit and 3.5-bit GGUF files, about 13 and 15 GB instead of 69 GB, for people who run local models with llama.cpp.
New
DeepSeek-V4.1-Flash-1017 Maya GGUF
peasantsmith · Kit
Runs a 748B DeepSeek mixture-of-experts model on a home PC through two GGUF quantizations made for Project Maya. For people with a big-RAM machine and a fast S…
New
MiniCPM5-2B-GGUF
openbmb · Kit
Gives you MiniCPM5-2B, a small dense text model for English and Chinese, as GGUF files for on-device and local use. Suits people who want a compact model for c…
New
ttf-Qwen3.8-Flash-Next-GGUF
oguzeldereli · Kit
Runs Qwen3.8-Flash-Next, a 180B mixture-of-experts model squeezed to ternary weights, from one 40.4 GB GGUF file that is 4.6 times smaller than the FP8 release…
New
ttf-Qwen3.8-27B-GGUF
oguzeldereli · Kit
Runs Qwen3.8-27B squeezed to ternary weights as GGUF files that fit on a 12 GB GPU, in an 8.2 GB and a 6.74 GB variant. For people who want a large local model…
New
Hermes-3-Llama-3.1-8B-GGUF
NousResearch · Kit
Runs Hermes 3, an 8B general-purpose chat model from NousResearch, as a quantized GGUF file for llama.cpp. Suits people who want a local assistant with functio…
New
AREX-2-i1-GGUF
mradermacher · Kit
Weighted GGUF quantizations of BAAI/AREX-2, a 26.9B vision model, in about two dozen sizes from 7.2 GB to 22.2 GB, plus an imatrix file for making your own qua…
New
GGUF build of LiquidAI's LFM2.5-8B-A1B, a sparse mixture-of-experts model, with DavidAU's Turbo Brilliance system and 12 reasoning modes. An 8.5B beta-style re…
New
GGUF build of LiquidAI's LFM2.5-2.6B with DavidAU's Turbo Brilliance system, adding 12 reasoning and 12 instruct modes you switch in the prompt. A 2.7B beta fo…
New
Qwen3.8-27B-GGUF by bartowski
bartowski · Kit
A set of GGUF quantizations of Qwen3.8-27B by bartowski, from Q8_0 down to 3-bit, made with an importance matrix. For people running a 27B vision-language mode…
New
Jackrong_Qwopus3.8-27B-Coder-Flash-GGUF
bartowski · Kit
GGUF quantizations of Jackrong's Qwopus3.8-27B-Coder-Flash, made by bartowski with an importance matrix, in sizes from 17 GB to 55 GB. For running a 27B model…
New
Qwen3.5-9B-MTP-GGUF
unsloth · Kit
GGUF copies of Qwen3.5 9B that support multi-token-prediction speculative decoding in llama.cpp for faster generation. For people running the model locally who…
New
Qwen3.5-0.8B-GGUF
unsloth · Kit
Reads images and text and answers in text, as a small GGUF copy of Qwen3.5-0.8B by unsloth. Meant for local prototyping, fine-tuning and research.
New
gpt-oss-20b-GGUF
unsloth · Kit
Runs OpenAI's open-weight gpt-oss-20b reasoning model on your own computer, packed as GGUF files by unsloth. Suits developers who want a local model with adjus…
New
Qwen3.8-27B-1C
sweetand · Kit
Helps developers on the 1C:Enterprise platform by reading and fixing BSL code and finding objects in XML exports. A Russian-first fine-tune of Qwen3.8-27B, off…
New
Wan2.2-I2V-A14B-GGUF
QuantStack · Kit
Provides GGUF files of Wan2.2-I2V-A14B, a 14B model that turns a still image into a video, for use in ComfyUI with the ComfyUI-GGUF node. For people making sho…
New
Bonsai-27B-gguf
prism-ml · Kit
Runs a 27B-class reasoning model as a 1-bit GGUF file of about 3.9 GB for llama.cpp, so it fits a laptop or one GPU. For people who want local reasoning on eve…
New
Sharp-Spark-X2.5-4B-GGUF
peculiar-ragdoll · Kit
Compressed GGUF copies of the 4B Spark-X2.5 coding model, tuned for long context on GPUs with about 6 GB of memory. Made for developers who want a local coder…
New
Qwen3.8-27B-GGUF by lmstudio-community
lmstudio-community · Kit
A GGUF quantization of Qwen's Qwen3.8-27B made by the LM Studio team with llama.cpp, for people who run a 27B model on their own computer.
New
Raon-1 mini (GGUF)
KRAFTON · Kit
Runs a 28.8B mixture-of-experts model tuned for Korean chat, reasoning and tool-using agents in llama.cpp. GGUF copy of Raon-1 mini preview for people who run…
New