Nanbeige_Nanbeige4.3-33B-GGUF
bartowski · Kit
GGUF quantizations of Nanbeige4.3-33B, made by bartowski with an importance matrix, from about 21 GB to 66 GB. For running a 33B English and Chinese text model…
New
AI projects from Hugging Face
Categories and filters
Listings
gemma-4-31B-it-GGUF
unsloth · Kit
Runs Google's Gemma 4 31B instruction-tuned model locally from Unsloth's GGUF files, with text and image input and a long context. Suits developers who want a…
New
GLM-5.3-Flash Maya GGUF
peasantsmith · Kit
Five GGUF compressions of GLM-5.3-Flash, a 321B mixture-of-experts model, sized from 73.4 GB to 156.3 GB for Project Maya, which spreads the model across GPU,…
New
Qwen3.6-35B-A3B-MTP-GGUF
unsloth · Kit
Runs Qwen3.6-35B-A3B locally from Unsloth's GGUF files with multi-token prediction for faster decoding in llama.cpp. Suits developers who want a local agentic…
New
flint-GGUF
unsloth · Kit
Runs Flint, a 39.8B mixture-of-experts model for coding agents that uses about 2.5B parameters per token, from Unsloth GGUF files. For developers who run codin…
New
Thinklite-27B-GGUF
Sparset · Kit
A 4-bit GGUF copy of Thinklite-27B for llama.cpp that uses less reasoning per answer than its base model, for people running a 27B text model locally.
New
Arete-27B-GGUF
AtomicChat · Kit
Runs Nous Research's Arete 27B, a Qwen3.8-27B fine-tune that reads text and images, from GGUF files in six sizes with measured quality losses. For people runni…
New
Qwen3.6-35B-A3B-GGUF
unsloth · Kit
Runs Qwen3.6-35B-A3B, a mixture-of-experts model that reads images and text and uses about 3B parameters per token, from Unsloth GGUF files. For developers who…
New
Sharp-Spark-X2.6-4B-GGUF
peculiar-ragdoll · Kit
Runs a 4B coding model with long context on a graphics card with 6 GB of memory. These GGUF quants of Spark-X2.6-4B come in three sizes and use a coding-weight…
New
Qwen3.8-27B Turbo Brilliance NEO MAX MTP GGUF
DavidAU · Kit
Runs Qwen3.8-27B in GGUF form with a set of reasoning and instruct modes you switch from your prompt. For people who run local models and like to tune how the…
New
Ripple-65B-Preview-GGUF
AtomicChat · Kit
GGUF quantized files of the 65B Ripple Preview agentic-coding model, for running locally with llama.cpp. For people who run large open models on their own hard…
New
DeepSeek-V4.1-Flash-1017-GGUF
unsloth · Kit
Unsloth's GGUF quantizations of DeepSeek-V4.1-Flash-1017, a huge image-and-text model, for running locally on a machine with 128 GB or more of RAM. For people…
New
Qwen3.8-Flash-Next-GSQ-RCO-Coder-GGUF
ISTA-DASLab · Kit
A coding-focused GGUF build of Qwen3.8-Flash-Next with half its experts removed, cutting 354 GB at BF16 to 58.4 GB while keeping image input. For people with l…
New
dale-0.8b-GGUF
manuelgscom · Kit
A small 4-bit GGUF model that turns a plain request in Spanish or English into one Linux bash command. It runs offline on a CPU inside the dale tool. For peopl…
New
Qwen3.8-Flash-Next-GSQ-RCO-GGUF
ISTA-DASLab · Kit
GGUF versions of Qwen3.8-Flash-Next at four sizes, with each tensor quantized at its own precision and a vision projector for image input. For people running a…
New
Qwen3.8-27B-GSQ-RCO-GGUF
ISTA-DASLab · Kit
ISTA-DASLab's GGUF versions of Qwen3.8-27B in four sizes, each tensor quantized at its own precision, with a vision projector for images. Suits people who run…
New