AI projects from Hugging Face

Qwen Sharp Chat Templates

peculiar-ragdoll · Kit

Replaces the chat template of Qwen3.5, 3.6 and 3.8 models so they think less before answering and write tighter replies. For people running Qwen locally for co…

Qwen3.8-27B-GGUF by lmstudio-community

lmstudio-community · Kit

A GGUF quantization of Qwen's Qwen3.8-27B made by the LM Studio team with llama.cpp, for people who run a 27B model on their own computer.

Raon-1 mini (GGUF)

KRAFTON · Kit

Runs a 28.8B mixture-of-experts model tuned for Korean chat, reasoning and tool-using agents in llama.cpp. GGUF copy of Raon-1 mini preview for people who run…

Sage-A1.5 GGUF (Q4_K_M)

InternScience · Kit

Runs Sage-A1.5, a 35B mixture-of-experts agentic model for long scientific tasks, as a 4-bit GGUF file. It can split work across subagents and check its own pr…

Qwen3.8-2B-Distill-GGUF

empero-ai · Kit

Runs a small 2B reasoning model on phones, laptops and single-board computers, as GGUF files in five quant levels. A distillation of a large Qwen3.8 model, pac…

Nanbeige_Nanbeige4.3-33B-GGUF

bartowski · Kit

GGUF quantizations of Nanbeige4.3-33B, made by bartowski with an importance matrix, from about 21 GB to 66 GB. For running a 33B English and Chinese text model…

Qwen3.5-0.8B Astra Weight Edit

JonathanColetti · Kit

Fixes the repeat loops that Qwen3.5-0.8B falls into in thinking mode by editing two weight tensors directly, with no training. A small image-text model for Tra…

Qwen3.8-4B-Distill-GGUF

empero-ai · Kit

Runs a 4B reasoning model on a laptop or a mid-range graphics card, as GGUF files in five quant levels. A distillation of a large Qwen3.8 model, packaged by Em…

gemma-4-12B-it-qat-GGUF

unsloth · Kit

Gemma 4 12B in GGUF form, trained with quantization-aware training so a 4-bit copy keeps near-bfloat16 quality. For people running Gemma locally with llama.cpp…

Bielik-11B-v3.1-Instruct GGUF

speakleash · Kit

Chat model that answers in Polish, English and six other languages, packed as GGUF files in five sizes for llama.cpp or Ollama. For people who want an instruct…

GLM-5.3-Flash-Coder-RCO-152E-GGUF

lapadatbogdan · Kit

Runs a pruned GLM-5.3-Flash coding and agent model on a home PC, as GGUF files in five quant sizes. It keeps 152 of 288 experts per layer, cutting a 321B model…

Qwen3-8B-GGUF

Qwen · Kit

Runs Qwen3-8B as quantized GGUF files in llama.cpp or Ollama, with a thinking mode for math, code and logic and a plain mode for chat. For people who want a lo…

jevos-v4

feder-cr · Kit

A local decision model that answers yes-or-no, multiple-choice and score questions about a text on a laptop CPU in about 28 to 130 ms, returning a probability…

Qwen3.8-9B-Distill-GGUF

empero-ai · Kit

GGUF quantizations of Empero's Qwen3.8-9B, a reasoning model distilled from a larger Qwen3.8 into the Qwen3.5-9B design, for llama.cpp, Ollama, LM Studio and s…

ZONOS3-Mini GGUF

AtomicChat · Kit

Packs the ZONOS3-Mini text-to-speech model as GGUF files for llama.cpp, with 27 built-in voices and six backbone sizes from 0.41 to 1.61 GB. For developers run…

Gemma4-12B v2 Coding + Agentic Edition

yuxinlu1 · Kit

A GGUF fine-tune of Google's Gemma 4 12B instruction model for coding and tool-using agent work, sized to run offline on a machine with about 4.5 GB of free me…

Qwen3.8-35B-A3B-Distill-GGUF

empero-ai · Kit

Runs a 35B Mixture-of-Experts model with about 3B active parameters per token from GGUF files in ten sizes, plus a vision projector. For llama.cpp, Ollama, LM…

humanizer by jialinyyzz

jialinyyzz · Kit

Rewrites AI-written drafts such as emails, essays, reports and forum posts so they read like a person wrote them, in English and Chinese. A 12B model that keep…

Qwen3.6-35B-A3B-MTP-GGUF

unsloth · Kit

Runs Qwen3.6-35B-A3B locally from Unsloth's GGUF files with multi-token prediction for faster decoding in llama.cpp. Suits developers who want a local agentic…

Qwopus3.8-27B-Coder-Flash-GGUF

Jackrong · Kit

Helps with coding and tool-using agent work as a GGUF fine-tune of Qwen3.8-27B, trained on about 200,000 code, agent and reasoning examples. For developers who…

Alpie Seed 9B GGUF

169Pi · Kit

Runs Alpie Seed 9B, an image-and-text model from 169Pi AI, on your own machine through GGUF files in three bit depths. Suits developers who want local vision-l…

Qwen2.5-Coder-7B-Instruct-GGUF

Qwen · Kit

Runs a 7B instruction-tuned coding model from Qwen on your own machine, packed as GGUF files in eight quantization levels. Made for developers who want code he…

Qwen-Fixed-Chat-Templates

froggeric · Kit

Swaps Qwen's official chat templates for one drop-in Jinja file that fixes rendering errors, cache invalidation, wasted tokens and agent stalls. For people who…

Thinklite-27B-GGUF

Sparset · Kit

A 4-bit GGUF copy of Thinklite-27B for llama.cpp that uses less reasoning per answer than its base model, for people running a 27B text model locally.

S5-nano-GGUF

maritaca-ai · Kit

Runs Maritaca AI's S5-nano, a 4B model tuned for Brazilian Portuguese with function calling and a think mode, from GGUF files of 2.8 to 8.7 GB for llama.cpp an…

Arete-27B-GGUF

AtomicChat · Kit

Runs Nous Research's Arete 27B, a Qwen3.8-27B fine-tune that reads text and images, from GGUF files in six sizes with measured quality losses. For people runni…

MNN-Pocket-0.3B-GGUF

taobao-mnn · Kit

Runs a compact 0.3B Chinese and English language model from GGUF files of 192 to 726 MB, made for phones, laptops and other on-device use with llama.cpp, LM St…

BotPsy-0.8B-GGUFs

qvac · Kit

GGUF copies of the 0.8B BotPsy tool-calling model in BF16, Q8_0 and Q4_K_M, for running agent and function-calling work fully on your own device with llama.cpp.

Sharp-Spark-X2.6-4B-GGUF

peculiar-ragdoll · Kit

Runs a 4B coding model with long context on a graphics card with 6 GB of memory. These GGUF quants of Spark-X2.6-4B come in three sizes and use a coding-weight…

Raon-1 nano (GGUF)

KRAFTON · Kit

Packages the Raon-1 nano language model as GGUF files for llama.cpp, so developers can run a Korean and English chat model on their own computer. Four quant ty…

Ripple-65B-Preview-GGUF

AtomicChat · Kit

GGUF quantized files of the 65B Ripple Preview agentic-coding model, for running locally with llama.cpp. For people who run large open models on their own hard…

Qwen3.8-27B GGUF (ShapeLearn Quantized)

byteshape · Kit

Runs Qwen3.8-27B as GGUF files quantized by ByteShape's ShapeLearn, in five GPU-sized options with vision input and MTP speculative decoding in llama.cpp. For…

dale-0.8b-GGUF

manuelgscom · Kit

A small 4-bit GGUF model that turns a plain request in Spanish or English into one Linux bash command. It runs offline on a CPU inside the dale tool. For peopl…

Qwen3.8-27B-DSpine-b16-GGUF

aj9o9 · Kit

A GGUF draft model that speeds up Qwen3.8-27B in llama.cpp through speculative decoding, reaching about 125 tokens per second on code and math on one RTX 3090.…

Qwen3.8-27B-GSQ-RCO-GGUF

ISTA-DASLab · Kit

ISTA-DASLab's GGUF versions of Qwen3.8-27B in four sizes, each tensor quantized at its own precision, with a vision projector for images. Suits people who run…