AI projects from Hugging Face

gemma-4-31B-it-qat-GGUF

unsloth · Kit

Runs Google's Gemma 4 31B instruction model from Unsloth's 4-bit QAT GGUF files, with an included drafter for faster speculative decoding in llama.cpp. For peo…

Flint NVFP4 GGUF

RecursiveSI · Kit

A 4-bit NVFP4 copy of the Recursive Flint text model as one GGUF file, built for NVIDIA GPUs through llama.cpp. For developers running a large local model with…

Qwen3.5-0.8B-weight-space-programming-GGUF by NotCherry

NotCherry · Kit

Packages the Qwen3.5-0.8B weight-space-programming model as GGUF files for llama.cpp, with a 4-bit text model and a separate vision projector for image input.

Qwen3.5-9B-OptiQ-4bit

mlx-community · Kit

A 4-bit mixed-precision MLX version of Qwen3.5-9B for local text generation on Apple Silicon, with a bundled multi-token prediction head. For Mac users who run…

GLM-5.3-Flash EXL3 3.5bpw

Mia-AiLab · Kit

Quantized copy of GLM-5.3-Flash in EXL3 format, 156 GB, with narrower routed experts, about 11 percent smaller than the same lab's 4-bit version. For people ru…

K2-Horizon-7B-GGUF

IFM · Kit

Quantized GGUF copies of IFM's K2-Horizon-7B text model for running locally in llama.cpp, from BF16 down to 4-bit, with a 512K-token context window.

Hydrogen-1.0 NVFP4

deep-principle · Kit

A 4-bit NVFP4 build of Hydrogen-1.0, a 381B science and research assistant model from Deep Principle, based on GLM-5.3. It needs a multi-GPU NVIDIA Blackwell s…

Qwen3.8-27B-AWQ-INT4

cyankiwi · Kit

A 4-bit AWQ quantization of Qwen3.8-27B by cyankiwi, a 27B vision-language model with thinking control. Weights are 21.02 GB and load in Transformers, vLLM or…

KAT-Coder-V2.5-Dev GGUF

bartowski · Kit

Imatrix GGUF quantizations of Kwaipilot's KAT-Coder-V2.5-Dev, a 34.7B text model, with 4-bit files of about 19 GB or more. For people who run a large coder-nam…

DeepSeek V4.1 Flash GGUF for DwarfStar

antirez · Kit

Gives Mac users calibrated 2-bit and 4-bit GGUF files of DeepSeek V4.1 Flash, plus a separate vision encoder, for DwarfStar's Metal engine with SSD streaming.…

MNN-Pocket-0.3B-MNN

taobao-mnn · Kit

Runs a 0.3B Chinese and English chat model on phones and edge devices through the MNN runtime, as a 4-bit build of about 173 MB. For developers adding on-devic…

Qwen3.8-27B-Splash

incoai · Kit

Serves Qwen3.8-27B on Apple silicon Macs through Inco AI's Splash engine, with a 4-bit model, a DFlash 2 draft and a vision encoder in one package. Works only…

Qwen3-VL for ComfyUI

Comfy-Org · Kit

Repackaged Qwen3-VL 4B and 8B model files for ComfyUI's text encoder folder, offered in several precisions from bf16 to 4-bit styles. For ComfyUI users who nee…

Wan2.2 TI2V 5B GGUF

QuantStack · Kit

A 5B-parameter text-to-video model converted to GGUF for ComfyUI, about 2.5 GB at 4-bit by estimate, for English and Chinese prompts. It suits ComfyUI users wh…

DeepSeek-V4.1-Flash-1017 TrellisMX K2 Mix

brandonmusic · Kit

A compressed copy of DeepSeek-V4.1-Flash-1017 sized for two 96 GB GPUs, with a few experts stored at higher precision. A research build for people who serve la…

Qwen3.8-27B-4bit (MLX)

mlx-community · Kit

4-bit MLX conversion of Qwen3.8-27B that reads text and images and answers in text, run with the mlx-vlm tool. For developers who want to run a vision-language…

Sage-A1.5 GGUF (Q4_K_M)

InternScience · Kit

Runs Sage-A1.5, a 35B mixture-of-experts agentic model for long scientific tasks, as a 4-bit GGUF file. It can split work across subagents and check its own pr…

gemma-4-12B-it-qat-q4_0-gguf

google · Kit

Runs Google's Gemma 4 12B instruction-tuned model in a 4-bit GGUF file made with quantization-aware training. Reads text and images, and suits laptops and cons…

gemma-4-E4B-it-GGUF

unsloth · Kit

A 4-bit GGUF copy of Google's Gemma 4 E4B instruction model, packaged by Unsloth for running on your own machine. It reads text and images and answers in text.

Spark-X2.6-1.7B-GGUF

XHToken · Kit

Runs a small 1.7B on-device language model from XHToken as 4-bit GGUF files, for chat, coding and agent tasks in English and Chinese, with adjustable thinking…