AI projects from Hugging Face

Tess-4.5-27B GGUF

migtissera · Kit

GGUF builds of Tess-4.5, a 27B open-weights coding and agent model, for llama.cpp, with a vision projector and optional draft heads for faster generation. They…

Qwen3.6-35B-A3B lododo-Distill-v1.0 (GGUF)

lododoai · Kit

Runs as a local text model, a Qwen3.6-35B-A3B fine-tune trained on data written by Qwen3.8-27B and packed as one GGUF file for llama.cpp. For people who run mo…

Qwen3.8-27B-SLQ-GGUF

kaitchup · Kit

Compresses Qwen3.8-27B into three GGUF files with different size and fidelity levels, using a custom statistically lossless quantization. For people who run th…

K2-Horizon-7B-GGUF

IFM · Kit

Quantized GGUF copies of IFM's K2-Horizon-7B text model for running locally in llama.cpp, from BF16 down to 4-bit, with a 512K-token context window.

Qwen3.8-27B Intel Arc Tuned

Greatjedi · Kit

Runs a 27B Qwen3.8 model in GGUF files retuned for Intel Arc GPUs, with pure decode near 22 tokens a second in the author's tests. For people running llama.cpp…

Qwen3-Reranker-0.6B-Q8_0-GGUF

ggml-org · Kit

Ranks passages by relevance to a query, as an 8-bit GGUF copy of the Qwen3 0.6B reranker made with llama.cpp. For developers who want a small local reranker fo…

Laya-GGUF

ggml-org · Kit

Small 421M-parameter decision model in GGUF form that you serve locally and call through a systemone API. For developers who use llama.cpp tooling and want a c…

DeepSeek-V4.1-Flash-1017 GGUF

ggml-org · Kit

GGUF files of DeepSeek's 748B V4.1 Flash 1017 model, converted by ggml-org with a vision file for images, for people with big-memory machines who run models th…

POCKET-35B-GGUF

FINAL-Bench · Kit

Runs a Korean-tuned 35B model on your own PC from GGUF files with llama.cpp, with a CPU-only path so no GPU is needed. For people who want a local language mod…

KVARK Sparkle 1.1 27B GGUF

Egzakta · Kit

Runs the 27B KVARK Sparkle 1.1 model from GGUF files in several sizes, with optional image input and speculative decoding. For people running models locally wi…

Kvark-Sparkle-1.0-27B-GGUF

Egzakta · Kit

GGUF files of KVARK Sparkle 1.0, a 27B vision-language model, for llama.cpp, Ollama and LM Studio, with the speculative-decoding head kept. For people running…

Qwen3.8-27B iMatrix NVFP4 MTP GGUF

cdiamond · Kit

A 17.1 GB mixed-precision GGUF of Qwen3.8-27B that keeps its multi-token prediction layer, tuned for 256K context with vision on a 24 GB GPU. For people who ru…

Qwen3.6-35B-A3B MTP GGUF

byteshape · Kit

Runs Qwen3.6-35B-A3B from a GGUF quantization with Multi-Token Prediction for faster GPU decoding in llama.cpp. Made by ByteShape for people running local mode…

Llama-3.2-3B-Instruct-GGUF

bartowski · Kit

GGUF quantizations of Meta's Llama-3.2-3B-Instruct, made by bartowski with an importance matrix, from about 1.8 GB to 6.4 GB. For running a small chat model lo…

Spark-X2.6-1.7B-DSpark-GGUF

XHToken · Kit

A small draft model that speeds up Spark-X2.6-1.7B through speculative decoding, guessing up to seven tokens per step. For people who run that model locally on…

Mica-v0.5-4B

sky7350 · Kit

A 4B classifier built on Qwen3.5-4B that reads an input and returns a probability for each allowed answer, for guardrails, routing, triage and agent gates. For…

Qwen3-4B-GGUF

Qwen · Kit

A 4B chat model in GGUF format that runs locally in llama.cpp or ollama, with a thinking mode for reasoning and a plain mode for quick replies. Suits developer…

Qwen2.5-Coder-14B-Instruct-GGUF

Qwen · Kit

Gives you the Qwen2.5-Coder 14B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp. For developers who want a stronger lo…

Qwen2.5-Coder-1.5B-Instruct-GGUF

Qwen · Kit

Gives you the small Qwen2.5-Coder 1.5B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp on a laptop. For developers who…

Rein-NPC-4B

jmc0 · Kit

Drives game characters that hold a conversation, take in-game actions such as selling an item or calling guards, and stay in character under pressure. For game…