Mellum2.1-12B-A2.5B-Thinking-GGUF
JetBrains · Kit
Runs JetBrains' 12B reasoning model locally in llama.cpp, Ollama or LM Studio, with five GGUF sizes to pick from. For developers who want a thinking model with…
New
AI skills and agents for developers
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Categories and filters
Listings
Axion-1.0-35B-APEX-I-MiniPlus-V2.1-GGUF
IsValorum · Kit
Runs the 35B Axion-1.0 model locally in llama.cpp from one compressed GGUF file with mixed precision. A quantized release by IsValorum for people who want a la…
New
gpt-oss-20b-GGUF by ggml-org
ggml-org · Kit
Generates text on your own computer from a GGUF copy of OpenAI's gpt-oss-20b, packaged by ggml-org. For people who want to run an open 20B model locally in the…
New
Qwen3.8-27B-Ridge-GGUF
empero-ai · Kit
Runs Qwen3.8-27B as a compact 3.7 bits-per-weight GGUF file that suits a 16 GB GPU, with optional image input. For people running models locally with llama.cpp…
New
Qwen3.6-35B-A3B 2-bit GSQ GGUF
chtisgit · Kit
Runs a 35B Qwen model in a 2-bit GSQ GGUF conversion with a separate vision projector for llama.cpp. For people who want a large model in a small file on CPU o…
New
Qwen3.6-35B-A3B GGUF (ShapeLearn Quantized)
byteshape · Kit
Quantized GGUF versions of Qwen3.6-35B-A3B that read images and text, with CPU and GPU variants from about 9 GB, made with ByteShape's ShapeLearn. For develope…
New
Spark-X2.6-4B GGUF
bartowski · Kit
Small English and Chinese chat model as GGUF files from full bf16 down to about 2.4 GB, for llama.cpp, with a low or high thinking setting. For developers who…
New
Qwen3.6-35B-A3B-coding-reap50-GGUF
anik-jha · Kit
Writes code with Qwen3.6-35B-A3B cut to half its experts and packed as GGUF files for llama.cpp. Made for developers who want a coding model that fits in less…
New
Spark-X2.6-4B-DSpark-GGUF
XHToken · Kit
Speeds up text generation for Spark-X2.6-4B as a small draft model for speculative decoding, in GGUF format. Meant for people running that model locally with l…
New
DeepSeek-V4.1-Flash-1017-exl3
turboderp · Kit
Runs a compressed DeepSeek-V4.1-Flash-1017 in ExLlamaV3 at 1.68, 2.25 or 2.68 bits per weight. For people who run large models on their own hardware and want l…
New
Nanbeige4.3-33B-GGUF-UltraOptimised-Curated-Protium
SolsticeAI · Kit
Offers GGUF quantizations of the 33.1B Nanbeige4.3 model for llama.cpp and Ollama, with a reasoning protocol and up to 524,288 tokens of context. For developer…
New
Qwen2.5-1.5B-Instruct-GGUF
Qwen · Kit
Gives you the small Qwen2.5 1.5B chat model as GGUF files in eight quantization sizes, for running with llama.cpp on a laptop or modest GPU. For people who wan…
New
Ornith-1.5-35B-A3B-GSQ-RCO-GGUF
pfeifferj · Kit
Shrinks the Ornith-1.5-35B-A3B text model to 3-bit and 3.5-bit GGUF files, about 13 and 15 GB instead of 69 GB, for people who run local models with llama.cpp.
New
ttf-Qwen3.8-Flash-Next-GGUF
oguzeldereli · Kit
Runs Qwen3.8-Flash-Next, a 180B mixture-of-experts model squeezed to ternary weights, from one 40.4 GB GGUF file that is 4.6 times smaller than the FP8 release…
New
Hermes-3-Llama-3.1-8B-GGUF
NousResearch · Kit
Runs Hermes 3, an 8B general-purpose chat model from NousResearch, as a quantized GGUF file for llama.cpp. Suits people who want a local assistant with functio…
New
Hermes 3 Llama-3.1 8B
NousResearch · Kit
An 8B general-purpose chat model from Nous Research, built on Llama 3.1, with function calling, structured output, role play and code help. It suits developers…
New
Qwen3.8-27B-GGUF by bartowski
bartowski · Kit
A set of GGUF quantizations of Qwen3.8-27B by bartowski, from Q8_0 down to 3-bit, made with an importance matrix. For people running a 27B vision-language mode…
New
Jackrong_Qwopus3.8-27B-Coder-Flash-GGUF
bartowski · Kit
GGUF quantizations of Jackrong's Qwopus3.8-27B-Coder-Flash, made by bartowski with an importance matrix, in sizes from 17 GB to 55 GB. For running a 27B model…
New
Qwen3.5-9B-MTP-GGUF
unsloth · Kit
GGUF copies of Qwen3.5 9B that support multi-token-prediction speculative decoding in llama.cpp for faster generation. For people running the model locally who…
New
Qwen3.8-27B-exl3
turboderp · Kit
EXL3 quantized copies of Qwen3.8-27B in many bits-per-weight sizes, from 1.40 to 6.00. For people running the 27B model locally with ExLlamaV3 on limited GPU m…
New