Qwen3.5-35B-A3B-GGUF
unsloth · Kit
Reads text and images, writes code and calls tools on your own machine, as Unsloth's refreshed GGUF files for the Qwen3.5 35B-A3B vision-language model. For de…
New
AI projects from Hugging Face
Categories and filters
Listings
Z-Image-Turbo-GGUF by unsloth
unsloth · Kit
Unsloth's GGUF files of Z-Image-Turbo, a fast distilled text-to-image model that the authors say fits on a 16 GB consumer GPU. For people who generate images l…
New
Qwen3.6-27B-MTP-GGUF
unsloth · Kit
Codes and reasons with Qwen3.6 27B in GGUF files by Unsloth that carry multi-token prediction, which the card says speeds up replies about 1.5 to 2 times with…
New
Qwen3.5-0.8B-MTP-GGUF
unsloth · Kit
Runs the small Qwen3.5 0.8B vision-language model in llama.cpp with multi-token prediction for faster generation, as Unsloth's GGUF files. For developers testi…
New
Muse Glimmer 30B GGUF
unsloth · Kit
Runs a 30B agent model locally that reads text and images, calls tools and retries failed calls, from Unsloth's GGUF files. For developers building local agent…
New
granite-4.1-8b-GGUF
unsloth · Kit
Follows instructions, calls tools and chats with IBM's Granite 4.1 8B model, in GGUF files by Unsloth that include chat template fixes. Made for business assis…
New
gemma-4-31B-it-qat-GGUF
unsloth · Kit
Runs Google's Gemma 4 31B instruction model from Unsloth's 4-bit QAT GGUF files, with an included drafter for faster speculative decoding in llama.cpp. For peo…
New
Qwen3.5-4B-Router-1M
MaziyarPanahi · Kit
Small decider that returns a calibrated probability for what an agent should do next and which tool it should call. For developers building agents and support…
New
Qwen3.5-4B-Judge-1M
MaziyarPanahi · Kit
Small judge model that returns a calibrated probability on whether a reply is backed by its source, whether text is unsafe, and which task or domain it belongs…
New
Qwen3.8-27B-Fable-5-Coding-Distilled
khazarai · Kit
Debugs and reviews code by checking real files before it proposes a fix, a Qwen3.8-27B fine-tune trained on 195M tokens of reasoning traces. For developers who…
New
Qwopus3.8-27B-Flash-V2-GGUF
Jackrong · Kit
Trims wasted reasoning in long agent tasks, as a GGUF build of the second Flash fine-tune of Qwen3.8-27B with better Python formatting. For people who run agen…
New
GGUF fine-tune of a 27B Qwen model by DavidAU, with switchable instruct and reasoning modes and a built-in help system. Hugging Face lists it as image text to…
New
Answers questions and reads images with much shorter thinking. GGUF builds of a 27B Qwen 3.8 tune from DavidAU that aims to cut reasoning tokens while keeping…
New
Forge-1-Gemma-4-E2B
YoSaNoo · Kit
A small coding-minded text model fine-tuned from Google's gemma-4-E2B and shared as GGUF files, so you can run it on your own laptop in Ollama, LM Studio, Unsl…
New
Llama-3.2-1B-Instruct-GGUF
unsloth · Kit
Chats, summarizes and answers questions in text on a laptop, as Unsloth's GGUF copy of Meta's small Llama 3.2 1B Instruct in precisions from 16-bit to 2-bit. F…
New
GLM-4-9B-0414-GGUF
unsloth · Kit
Generates text in Chinese and English from GGUF files of the 9.4B GLM-4-9B-0414 model, for people who want to run a GLM model on their own computer.
New
gemma-4-E2B-it-GGUF
unsloth · Kit
Unsloth's GGUF files of Google DeepMind's Gemma 4 E2B instruction-tuned model, which takes text and images and writes text, with a 128K context. For people who…
New
gemma-3-4b-it-GGUF
unsloth · Kit
Answers questions about text and images on your own computer, as a GGUF copy of Google's Gemma 3 4B instruction model packaged by Unsloth. For developers and u…
New
Qwen3.5-2B-GGUF
unsloth · Kit
Reads images and text and answers in text, as a small GGUF copy of Qwen3.5-2B by unsloth. Meant for local prototyping, fine-tuning and research.
New
MOSS-Image-SFT-GGUF
unsloth · Kit
Runs the MOSS-Image text to image model from compressed GGUF files on CPU, Mac or GPU, through Unsloth Studio or stable-diffusion.cpp. For people who make imag…
New