Raon-1 nano (GGUF)
KRAFTON · Kit
Packages the Raon-1 nano language model as GGUF files for llama.cpp, so developers can run a Korean and English chat model on their own computer. Four quant ty…
New
AI skills and agents for developers
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Categories and filters
Listings
Ripple-65B-Preview-GGUF
AtomicChat · Kit
GGUF quantized files of the 65B Ripple Preview agentic-coding model, for running locally with llama.cpp. For people who run large open models on their own hard…
New
Alpie Seed 9B
169Pi · Kit
Reads text, images and video and handles reasoning and coding with a 9B open-weight model built on Qwen3.5-9B, with GGUF builds for light hardware. For develop…
New
Qwen3.8-27B GGUF (ShapeLearn Quantized)
byteshape · Kit
Runs Qwen3.8-27B as GGUF files quantized by ByteShape's ShapeLearn, in five GPU-sized options with vision input and MTP speculative decoding in llama.cpp. For…
New
DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF
ISTA-DASLab · Kit
GGUF versions of DeepSeek-V4.1-Flash-1017 at three small sizes, with each tensor quantized at its own precision. For people running a huge mixture-of-experts m…
New
DeepSeek-V4.1-Flash-1017-GGUF
unsloth · Kit
Unsloth's GGUF quantizations of DeepSeek-V4.1-Flash-1017, a huge image-and-text model, for running locally on a machine with 128 GB or more of RAM. For people…
New
Ornith-1.5-9B-GGUF
ornith-ai · Kit
Offers GGUF files of Ornith-1.5-9B, a 9B dense model trained through a self-improvement loop, for single-GPU use. Aimed at developers who want a small model wi…
New
Qwen3.8-Flash-Next-GSQ-RCO-Coder-GGUF
ISTA-DASLab · Kit
A coding-focused GGUF build of Qwen3.8-Flash-Next with half its experts removed, cutting 354 GB at BF16 to 58.4 GB while keeping image input. For people with l…
New
dale-0.8b-GGUF
manuelgscom · Kit
A small 4-bit GGUF model that turns a plain request in Spanish or English into one Linux bash command. It runs offline on a CPU inside the dale tool. For peopl…
New
Qwen3.8-27B-DSpine-b16-GGUF
aj9o9 · Kit
A GGUF draft model that speeds up Qwen3.8-27B in llama.cpp through speculative decoding, reaching about 125 tokens per second on code and math on one RTX 3090.…
New
Qwen3.8-Flash-Next-GSQ-RCO-GGUF
ISTA-DASLab · Kit
GGUF versions of Qwen3.8-Flash-Next at four sizes, with each tensor quantized at its own precision and a vision projector for image input. For people running a…
New
DeepSeek-V4.1-Flash-1017-GSQ-RCO-Coder-GGUF
ISTA-DASLab · Kit
An expert pruned and quantized GGUF of DeepSeek-V4.1-Flash-1017 from ISTA-DASLab, aimed at code and agent work, with transformer weights of 72.1 GB. Suits deve…
New
Qwen3.8-27B-GSQ-RCO-GGUF
ISTA-DASLab · Kit
ISTA-DASLab's GGUF versions of Qwen3.8-27B in four sizes, each tensor quantized at its own precision, with a vision projector for images. Suits people who run…
New
Qwen2.5-0.5B QLoRA Demo
shambhuraje · Kit
A Gradio demo for a small fine-tuned Qwen2.5 0.5B instruct model in GGUF form. Lets developers and learners try the compact model in a browser without installi…
New
Local Model Explorer
LocalLLaMA · Kit
Shows which GGUF quantized models fit your graphics card, Mac or CPU, for people who run language models on their own machine and want to pick a file that work…
New
GGUF Model VRAM Calculator
DavidAU · Kit
Estimates how much video memory a GGUF model needs, in a static page that runs in your browser. Suits people choosing a quantized model that fits their graphic…
New