SmolLM3-3B-GGUF
unsloth · Kit
Chats and reasons with SmolLM3, a fully open 3B model that can think step by step or answer directly, in GGUF files by Unsloth with chat template fixes. Handle…
New
AI projects from Hugging Face
Categories and filters
Listings
Qwen3.6-35B-A3B-NVFP4-Fast
unsloth · Kit
Serves Qwen3.6 35B A3B in a fast NVFP4 build by Unsloth for vLLM on NVIDIA GPUs. The card says it has 1.79x the throughput of other NVFP4 builds and fits a 32…
New
Qwen3.6-27B-GGUF
unsloth · Kit
Handles agentic coding and image-plus-text tasks locally, as Unsloth's GGUF files for Qwen3.6-27B with thinking preservation and a long context. For developers…
New
Qwen3.5-4B-MTP-GGUF
unsloth · Kit
Unsloth's GGUF files of Qwen3.5-4B with multi-token prediction, which lets llama.cpp use speculative decoding for roughly 1.5 to 2 times faster generation. For…
New
Qwen3-30B-A3B-GGUF by unsloth
unsloth · Kit
GGUF files of Qwen3-30B-A3B, quantized by unsloth, for running a local chat and reasoning model in llama.cpp, Ollama or Open WebUI, with a thinking mode you ca…
New
Qwen3-14B-GGUF
unsloth · Kit
Gives you Qwen3 14B, a text generation model that can think through hard questions or answer fast, as GGUF files for your own computer. Packaged by unsloth for…
New
Qwen2.5-Coder-7B-Instruct-GGUF by unsloth
unsloth · Kit
Writes, explains and fixes code on your own computer, as Unsloth's GGUF copy of the Qwen2.5-Coder 7B instruction model. For developers who want a local coding…
New
Olmo-3-32B-Think-GGUF
unsloth · Kit
Gives you Olmo 3 32B Think, a 32.2B-parameter reasoning model, as GGUF files that run on your own computer. Packaged by unsloth for people who want a local mod…
New
Llama-3.2-3B-Instruct-GGUF by unsloth
unsloth · Kit
Chats, summarizes and answers questions with Meta's compact Llama 3.2 3B instruct model, in GGUF files by Unsloth from 2-bit up to 16-bit. Small enough for ord…
New
gpt-oss-120b-GGUF
unsloth · Kit
Runs OpenAI's open-weight gpt-oss-120b, a 117B model with 5.1B active parameters, from GGUF files by Unsloth that carry its fixes. Built for reasoning, agent t…
New
gemma-3-27b-it-GGUF
unsloth · Kit
Answers questions about text and images with Google's Gemma 3 27B instruction-tuned model, in GGUF files made by Unsloth for running on your own computer. It h…
New
gemma-3-270m-it-GGUF
unsloth · Kit
Generates text from prompts as a 268M instruction-tuned Gemma 3 model in GGUF format, small enough for laptops and desktops. For developers who want a tiny loc…
New
gemma-3-12b-it-GGUF
unsloth · Kit
Answers questions and summarizes text, and reads images, from GGUF files of Google's Gemma 3 12B instruction model. It suits people who want to run it on their…
New
ERNIE-4.5-21B-A3B-Thinking-GGUF
unsloth · Kit
Works through logic, math, science and coding problems with a 21B mixture-of-experts model that activates 3B parameters per token, in GGUF files by Unsloth. Su…
New
LFM2.5-350M-home-assistant-sft
OrdenWills · Kit
Turns plain home commands such as turn off the TV into structured tool calls, checking device states first. A 350M model for smart home builders and tinkerers.
New
Qwen3.8-27B Fable-5 Coding Distilled GGUF
mradermacher · Kit
GGUF quantized files of a 27.3B coding-distilled Qwen3.8 model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit developers who run a cod…
New
Qwopus3.8-27B-Flash-GGUF
Jackrong · Kit
Cuts reasoning time and cost for long agent tasks, as a GGUF build of a Qwen3.8-27B fine-tune. Made for people who run agent loops on their own machine and wan…
New
Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled-GGUF
Jackrong · Kit
Thinks through problems step by step inside think tags, as a 4B Qwen3.5 model fine-tuned on reasoning chains and packaged as GGUF. For people who run a small r…
New
Runs a tiny 0.8B reasoning-tuned chat model in the MLX format at 6-bit, converted from Jackrong's Qwen3.5 distilled model. For people who want a tiny local mod…
New
Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF
hesamation · Kit
Runs a reasoning-tuned Qwen3.6-35B-A3B on your own machine as GGUF files in four quant sizes, trained on Claude Opus 4.6 style reasoning data. For people who w…
New