AI projects from Hugging Face

DeepSeek-R1-GGUF

unsloth · Kit

GGUF copies of the 671B DeepSeek-R1 reasoning model, with 1.58-bit and 2-bit dynamic quants, for running it in llama.cpp on a local machine with enough memory.

Qwen3.8-27B Agention Precision GGUF

agentionai · Kit

Packs Qwen3.8-27B as llama.cpp GGUF files in eight sizes from 8.95 to 16.35 GiB, plus a vision projector. The author reports less drift from the BF16 model tha…

Qwen3.8-27B-CodeForge-3xMerge i1 GGUF

mradermacher · Kit

Importance-matrix GGUF quants of the Qwen3.8-27B-CodeForge-3xMerge model, from about 11 GB to 22.5 GB, for local use. For people running 27B models on their ow…

Maximizing Model Performance Guide

DavidAU · Kit

Guides you in tuning samplers and parameters for local language models, with steps for system prompts, reasoning models and expert settings in LM Studio, Silly…

RelayVSR X4 Quants

MATLOWAI · Kit

Pre-quantized Wan checkpoints for RelayVSR's 4x video upscaler, so it runs in ComfyUI on 16 GB and 24 GB graphics cards at 2560x1408 output, for video editors…

AREX-2-i1-GGUF

mradermacher · Kit

Weighted GGUF quantizations of BAAI/AREX-2, a 26.9B vision model, in about two dozen sizes from 7.2 GB to 22.2 GB, plus an imatrix file for making your own qua…

Sharp-Spark-X2.6-4B-GGUF

peculiar-ragdoll · Kit

Runs a 4B coding model with long context on a graphics card with 6 GB of memory. These GGUF quants of Spark-X2.6-4B come in three sizes and use a coding-weight…