DeepSeek-R1-GGUF
unsloth · Kit
GGUF copies of the 671B DeepSeek-R1 reasoning model, with 1.58-bit and 2-bit dynamic quants, for running it in llama.cpp on a local machine with enough memory.
New
AI skills and agents for developers
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Categories and filters
Listings
Qwen3.8-27B Agention Precision GGUF
agentionai · Kit
Packs Qwen3.8-27B as llama.cpp GGUF files in eight sizes from 8.95 to 16.35 GiB, plus a vision projector. The author reports less drift from the BF16 model tha…
New
Qwen3.8-27B-CodeForge-3xMerge i1 GGUF
mradermacher · Kit
Importance-matrix GGUF quants of the Qwen3.8-27B-CodeForge-3xMerge model, from about 11 GB to 22.5 GB, for local use. For people running 27B models on their ow…
New
RelayVSR X4 Quants
MATLOWAI · Kit
Pre-quantized Wan checkpoints for RelayVSR's 4x video upscaler, so it runs in ComfyUI on 16 GB and 24 GB graphics cards at 2560x1408 output, for video editors…
New
AREX-2-i1-GGUF
mradermacher · Kit
Weighted GGUF quantizations of BAAI/AREX-2, a 26.9B vision model, in about two dozen sizes from 7.2 GB to 22.2 GB, plus an imatrix file for making your own qua…
New
Sharp-Spark-X2.6-4B-GGUF
peculiar-ragdoll · Kit
Runs a 4B coding model with long context on a graphics card with 6 GB of memory. These GGUF quants of Spark-X2.6-4B come in three sizes and use a coding-weight…
New