Qwen3.5-0.8B-weight-space-programming-GGUF
prithivMLmods · Kit
GGUF copies of a small Qwen3.5 0.8B model whose weights were edited directly to reduce reasoning loops. For people who want to run it locally in several quant…
New
AI projects from Hugging Face
Categories and filters
Listings
Ornith-1.5-35B-A3B-GSQ-RCO-GGUF
pfeifferj · Kit
Shrinks the Ornith-1.5-35B-A3B text model to 3-bit and 3.5-bit GGUF files, about 13 and 15 GB instead of 69 GB, for people who run local models with llama.cpp.
New
MiniCPM5-2B-GGUF
openbmb · Kit
Gives you MiniCPM5-2B, a small dense text model for English and Chinese, as GGUF files for on-device and local use. Suits people who want a compact model for c…
New
ttf-Qwen3.8-Flash-Next-GGUF
oguzeldereli · Kit
Runs Qwen3.8-Flash-Next, a 180B mixture-of-experts model squeezed to ternary weights, from one 40.4 GB GGUF file that is 4.6 times smaller than the FP8 release…
New
ttf-Qwen3.8-27B-GGUF
oguzeldereli · Kit
Runs Qwen3.8-27B squeezed to ternary weights as GGUF files that fit on a 12 GB GPU, in an 8.2 GB and a 6.74 GB variant. For people who want a large local model…
New
Hermes-3-Llama-3.1-8B-GGUF
NousResearch · Kit
Runs Hermes 3, an 8B general-purpose chat model from NousResearch, as a quantized GGUF file for llama.cpp. Suits people who want a local assistant with functio…
New
GGUF build of LiquidAI's LFM2.5-8B-A1B, a sparse mixture-of-experts model, with DavidAU's Turbo Brilliance system and 12 reasoning modes. An 8.5B beta-style re…
New
GGUF build of LiquidAI's LFM2.5-2.6B with DavidAU's Turbo Brilliance system, adding 12 reasoning and 12 instruct modes you switch in the prompt. A 2.7B beta fo…
New
Qwen3.8-27B-GGUF by bartowski
bartowski · Kit
A set of GGUF quantizations of Qwen3.8-27B by bartowski, from Q8_0 down to 3-bit, made with an importance matrix. For people running a 27B vision-language mode…
New
Jackrong_Qwopus3.8-27B-Coder-Flash-GGUF
bartowski · Kit
GGUF quantizations of Jackrong's Qwopus3.8-27B-Coder-Flash, made by bartowski with an importance matrix, in sizes from 17 GB to 55 GB. For running a 27B model…
New
Sekai-1
8BitStudio · Kit
A 95.6M-parameter English chat model trained from scratch on one RTX 5060 Ti, small enough to run on a CPU. For people who want a tiny local language model to…
New
Wan2.1-T2V-1.3B
Wan-AI · Kit
Makes short 480P videos from a text prompt, small enough for most consumer GPUs with about 8 GB of video memory. For creators and researchers who want local te…
New
Qwen3.5-9B-MTP-GGUF
unsloth · Kit
GGUF copies of Qwen3.5 9B that support multi-token-prediction speculative decoding in llama.cpp for faster generation. For people running the model locally who…
New
Qwen3.5-0.8B-GGUF
unsloth · Kit
Reads images and text and answers in text, as a small GGUF copy of Qwen3.5-0.8B by unsloth. Meant for local prototyping, fine-tuning and research.
New
gpt-oss-20b-GGUF
unsloth · Kit
Runs OpenAI's open-weight gpt-oss-20b reasoning model on your own computer, packed as GGUF files by unsloth. Suits developers who want a local model with adjus…
New
Qwen3.8-27B-exl3
turboderp · Kit
EXL3 quantized copies of Qwen3.8-27B in many bits-per-weight sizes, from 1.40 to 6.00. For people running the 27B model locally with ExLlamaV3 on limited GPU m…
New
Supertonic 3
Supertone · Kit
Turns text into speech in 31 languages, running on your own device through ONNX Runtime with no cloud call. For developers who want fast local voice output wit…
New
Bonsai-27B-gguf
prism-ml · Kit
Runs a 27B-class reasoning model as a 1-bit GGUF file of about 3.9 GB for llama.cpp, so it fits a laptop or one GPU. For people who want local reasoning on eve…
New
Sharp-Spark-X2.5-4B-GGUF
peculiar-ragdoll · Kit
Compressed GGUF copies of the 4B Spark-X2.5 coding model, tuned for long context on GPUs with about 6 GB of memory. Made for developers who want a local coder…
New
Qwen Sharp Chat Templates
peculiar-ragdoll · Kit
Replaces the chat template of Qwen3.5, 3.6 and 3.8 models so they think less before answering and write tighter replies. For people running Qwen locally for co…
New
Qwen3.8-27B-4bit (MLX)
mlx-community · Kit
4-bit MLX conversion of Qwen3.8-27B that reads text and images and answers in text, run with the mlx-vlm tool. For developers who want to run a vision-language…
New
gemma-4-12B-it
google · Kit
Takes text, images and audio and writes text answers, in one 12B instruction-tuned model from Google DeepMind with a 256K-token context and configurable thinki…
New
Quark
FirstPrinciplesLabs · Kit
A 9B reasoning model for physics, science and maths, fine-tuned from Qwen3.5-9B by FirstPrinciples. For researchers who want step-by-step derivations and a sec…
New
CherryPit-1.2-2B
DRUPEs · Kit
A 2B coding and chat model built on MiniCPM5-2B that is much better at web apps needing several features in one component. For developers who want a small loca…
New
Nanbeige_Nanbeige4.3-33B-GGUF
bartowski · Kit
GGUF quantizations of Nanbeige4.3-33B, made by bartowski with an importance matrix, from about 21 GB to 66 GB. For running a 33B English and Chinese text model…
New
Spark-X2.6-1.7B
XHToken · Kit
Generates text with a compact 1.7B model for on-device use, with three adjustable thinking levels. Suits developers who want coding, agent and long-context hel…
New
Qwen2.5-VL-7B-Instruct-GGUF
unsloth · Kit
Unsloth's GGUF files of Qwen2.5-VL-7B-Instruct, a vision-language model that reads images, charts, documents and long videos and can output coordinates and str…
New
gemma-4-12b-it-GGUF
unsloth · Kit
Unsloth's GGUF quantized copy of Google's instruction-tuned Gemma 4 12B, a model that takes text, images, audio and video and writes text, for running locally.
New
Qwen3.8-27B-GGUF by ggml-org
ggml-org · Kit
Runs Qwen3.8-27B, a 26.9B model that takes images and text and replies in text, as a GGUF file for local use through the llama tools. Made for people who want…
New
Underdog Bark 3.0
ConwayResearch · Kit
Turns English speech into text with a 0.6B model in a 163 MB download, built on NVIDIA's Parakeet TDT 0.6B v3. For developers and Apple-silicon users who want…
New
Spark-X2.6-1.7B-GGUF
XHToken · Kit
Runs a small 1.7B on-device language model from XHToken as 4-bit GGUF files, for chat, coding and agent tasks in English and Chinese, with adjustable thinking…
New
gemma-4-12B-it-qat-GGUF
unsloth · Kit
Gemma 4 12B in GGUF form, trained with quantization-aware training so a 4-bit copy keeps near-bfloat16 quality. For people running Gemma locally with llama.cpp…
New
gemma-4-31B-it-GGUF
unsloth · Kit
Runs Google's Gemma 4 31B instruction-tuned model locally from Unsloth's GGUF files, with text and image input and a long context. Suits developers who want a…
New
Idol-GGUF
TimeLordRaps · Kit
An 8-bit GGUF build of SperiD Labs' Idol that turns one image into a 3D Gaussian point cloud and a mesh, run locally with idol.cpp. For developers working on i…
New
Qwen3-8B-GGUF
Qwen · Kit
Runs Qwen3-8B as quantized GGUF files in llama.cpp or Ollama, with a thinking mode for math, code and logic and a plain mode for chat. For people who want a lo…
New
halogen-qwen3.8-flash-next
peonist-ai · Kit
Holds the model weights for halogen-flash-server, an engine that runs Qwen3.8-Flash-Next on AMD Strix Halo machines, for owners of that hardware who want the m…
New
jevos-v4
feder-cr · Kit
A local decision model that answers yes-or-no, multiple-choice and score questions about a text on a laptop CPU in about 28 to 130 ms, returning a probability…
New
ZONOS3-Mini GGUF
AtomicChat · Kit
Packs the ZONOS3-Mini text-to-speech model as GGUF files for llama.cpp, with 27 built-in voices and six backbone sizes from 0.41 to 1.61 GB. For developers run…
New
Qwen3.5-4B-GGUF
unsloth · Kit
Unsloth's GGUF quantized copy of Qwen3.5-4B, a small model that reads images and text and answers in text, for people running models locally.
New
humanizer by jialinyyzz
jialinyyzz · Kit
Rewrites AI-written drafts such as emails, essays, reports and forum posts so they read like a person wrote them, in English and Chinese. A 12B model that keep…
New
DeepHat-V1-7B
DeepHat · Kit
A 7B coding model tuned for cybersecurity and DevOps work, fine-tuned from Qwen2.5-Coder-7B. For security and operations engineers who want a small local model…
New
Qwen3.6-35B-A3B-MTP-GGUF
unsloth · Kit
Runs Qwen3.6-35B-A3B locally from Unsloth's GGUF files with multi-token prediction for faster decoding in llama.cpp. Suits developers who want a local agentic…
New
flint-GGUF
unsloth · Kit
Runs Flint, a 39.8B mixture-of-experts model for coding agents that uses about 2.5B parameters per token, from Unsloth GGUF files. For developers who run codin…
New
Ling-3.0-tiny
inclusionAI · Kit
Generates text with a 7.9B hybrid reasoning model that activates only 1.3B parameters per token, so it fits local and low-resource setups. Suits developers who…
New
Needle 3
Cactus-Compute · Kit
A small on-device model from Cactus Compute for tool calling, structured extraction and text embeddings, used through the cactus Python package. For developers…
New
Alpie Seed 9B GGUF
169Pi · Kit
Runs Alpie Seed 9B, an image-and-text model from 169Pi AI, on your own machine through GGUF files in three bit depths. Suits developers who want local vision-l…
New
Qwen3.5-9B-GGUF
unsloth · Kit
Unsloth's GGUF quantized copy of Qwen3.5-9B, a mid-size model that reads images and text and answers in text, for people running models locally.
New
MiniCPM5-2B
openbmb · Kit
Generates text with a dense 2B-class model made for on-device and local use, covering coding, math, long context, tool use and agent tasks in English and Chine…
New
Qwen-Fixed-Chat-Templates
froggeric · Kit
Swaps Qwen's official chat templates for one drop-in Jinja file that fixes rendering errors, cache invalidation, wasted tokens and agent stalls. For people who…
New
Thinklite-27B-GGUF
Sparset · Kit
A 4-bit GGUF copy of Thinklite-27B for llama.cpp that uses less reasoning per answer than its base model, for people running a 27B text model locally.
New