Qwen3.8-27B-Randean-MXFP4
flechin · Kit
A 27B reasoning model tuned to answer plainly instead of hedging, quantized to MXFP4 so vLLM can serve it on a single 32 GB GPU, for developers who run local r…
New
AI projects from Hugging Face
Categories and filters
Listings
Qwen3.8-27B-Ridge-GGUF
empero-ai · Kit
Runs Qwen3.8-27B as a compact 3.7 bits-per-weight GGUF file that suits a 16 GB GPU, with optional image input. For people running models locally with llama.cpp…
New
Spark-X2.6-4B GGUF
bartowski · Kit
Small English and Chinese chat model as GGUF files from full bf16 down to about 2.4 GB, for llama.cpp, with a low or high thinking setting. For developers who…
New
Spark-X2.6-4B-DSpark-GGUF
XHToken · Kit
Speeds up text generation for Spark-X2.6-4B as a small draft model for speculative decoding, in GGUF format. Meant for people running that model locally with l…
New
Spark-X2.6-4B-Base
XHToken · Kit
A 4.1B language model for on-device use, tuned for coding, agent tasks, long context and reasoning in English and Chinese, with three thinking levels. For deve…
New
Qwen3.5-2B-GGUF
unsloth · Kit
Reads images and text and answers in text, as a small GGUF copy of Qwen3.5-2B by unsloth. Meant for local prototyping, fine-tuning and research.
New
Nanbeige4.3-33B-GGUF-UltraOptimised-Curated-Protium
SolsticeAI · Kit
Offers GGUF quantizations of the 33.1B Nanbeige4.3 model for llama.cpp and Ollama, with a reasoning protocol and up to 524,288 tokens of context. For developer…
New
Qwen2.5-1.5B-Instruct-GGUF
Qwen · Kit
Gives you the small Qwen2.5 1.5B chat model as GGUF files in eight quantization sizes, for running with llama.cpp on a laptop or modest GPU. For people who wan…
New
Qwen3.5-0.8B-weight-space-programming-GGUF
prithivMLmods · Kit
GGUF copies of a small Qwen3.5 0.8B model whose weights were edited directly to reduce reasoning loops. For people who want to run it locally in several quant…
New
Ornith-1.5-35B-A3B-GSQ-RCO-GGUF
pfeifferj · Kit
Shrinks the Ornith-1.5-35B-A3B text model to 3-bit and 3.5-bit GGUF files, about 13 and 15 GB instead of 69 GB, for people who run local models with llama.cpp.
New
MiniCPM5-2B-GGUF
openbmb · Kit
Gives you MiniCPM5-2B, a small dense text model for English and Chinese, as GGUF files for on-device and local use. Suits people who want a compact model for c…
New
ttf-Qwen3.8-Flash-Next-GGUF
oguzeldereli · Kit
Runs Qwen3.8-Flash-Next, a 180B mixture-of-experts model squeezed to ternary weights, from one 40.4 GB GGUF file that is 4.6 times smaller than the FP8 release…
New
ttf-Qwen3.8-27B-GGUF
oguzeldereli · Kit
Runs Qwen3.8-27B squeezed to ternary weights as GGUF files that fit on a 12 GB GPU, in an 8.2 GB and a 6.74 GB variant. For people who want a large local model…
New
Hermes-3-Llama-3.1-8B-GGUF
NousResearch · Kit
Runs Hermes 3, an 8B general-purpose chat model from NousResearch, as a quantized GGUF file for llama.cpp. Suits people who want a local assistant with functio…
New
GGUF build of LiquidAI's LFM2.5-8B-A1B, a sparse mixture-of-experts model, with DavidAU's Turbo Brilliance system and 12 reasoning modes. An 8.5B beta-style re…
New
GGUF build of LiquidAI's LFM2.5-2.6B with DavidAU's Turbo Brilliance system, adding 12 reasoning and 12 instruct modes you switch in the prompt. A 2.7B beta fo…
New
Qwen3.8-27B-GGUF by bartowski
bartowski · Kit
A set of GGUF quantizations of Qwen3.8-27B by bartowski, from Q8_0 down to 3-bit, made with an importance matrix. For people running a 27B vision-language mode…
New
Jackrong_Qwopus3.8-27B-Coder-Flash-GGUF
bartowski · Kit
GGUF quantizations of Jackrong's Qwopus3.8-27B-Coder-Flash, made by bartowski with an importance matrix, in sizes from 17 GB to 55 GB. For running a 27B model…
New
Sekai-1
8BitStudio · Kit
A 95.6M-parameter English chat model trained from scratch on one RTX 5060 Ti, small enough to run on a CPU. For people who want a tiny local language model to…
New
Wan2.1-T2V-1.3B
Wan-AI · Kit
Makes short 480P videos from a text prompt, small enough for most consumer GPUs with about 8 GB of video memory. For creators and researchers who want local te…
New