Qwen2.5-7B-Instruct-GGUF by Qwen
Qwen · Kit
Qwen2.5-7B-Instruct as GGUF files in eight quantization sizes, to chat with locally through llama.cpp. For people who want a capable 7.6B model on their own co…
Qwen · Kit
Qwen2.5-7B-Instruct as GGUF files in eight quantization sizes, to chat with locally through llama.cpp. For people who want a capable 7.6B model on their own co…
bartowski · Kit
GGUF quantizations of Rostam-S1-4B, a 4B reasoning model for math, physics, software work and Persian-English text. For people who run small models locally and…
bartowski · Kit
Imatrix GGUF quantizations of HemmingwayAI's Hemmingway-1.5, a 27B text model with MTP speculative decoding and a reasoning-effort prompt format. For people wh…
Asteromorph · Kit
Ranks search results by relevance with a reranker for STEM and general search, shipped as GGUF files for llama.cpp. For developers and researchers who want loc…
fastino · Kit
Pulls entities, relations and structured records out of English text, and classifies it, from one schema, running locally on CPU, CUDA or MPS. It suits develop…
AtomicChat · Kit
GGUF builds of Ornith 1.5 9B, a model that reads images and text, in sizes from 2.81 GB to 17.9 GB plus a vision projector. Pick the file that fits your graphi…
prithivMLmods · Kit
Writes code and builds interactive 3D scenes as self-contained Three.js pages, using GGUF copies of an early-preview Qwen3.5-4B fine-tune. For developers who p…
akhaliq · Kit
Makes images from text in two steps with no guidance pass, as a small adapter for MOSS-Image-SFT, plus a second adapter for light image edits. Made for people…
z-lab · Kit
A draft model in GGUF form that speeds up Qwen3.8-27B by proposing token blocks for the main model to verify. For people who run that model locally with llama.…
yuyangGong · Kit
A LoRA adapter for Llama-3.1-8B-Instruct that trains it to follow trusted instructions and ignore commands hidden in external data. A prompt injection defense…
XHToken · Kit
A compact 1.7B language model for on-device use in English and Chinese, with gains in coding, agent tasks and long context, and three adjustable thinking level…
unsloth · Kit
Handles agentic coding and image-plus-text tasks locally, as Unsloth's GGUF files for Qwen3.6-27B with thinking preservation and a long context. For developers…
unsloth · Kit
Unsloth's GGUF files of Qwen3.5-4B with multi-token prediction, which lets llama.cpp use speculative decoding for roughly 1.5 to 2 times faster generation. For…
unsloth · Kit
GGUF files of Qwen3-30B-A3B, quantized by unsloth, for running a local chat and reasoning model in llama.cpp, Ollama or Open WebUI, with a thinking mode you ca…
unsloth · Kit
Gives you Qwen3 14B, a text generation model that can think through hard questions or answer fast, as GGUF files for your own computer. Packaged by unsloth for…
unsloth · Kit
Writes, explains and fixes code on your own computer, as Unsloth's GGUF copy of the Qwen2.5-Coder 7B instruction model. For developers who want a local coding…
unsloth · Kit
Gives you Olmo 3 32B Think, a 32.2B-parameter reasoning model, as GGUF files that run on your own computer. Packaged by unsloth for people who want a local mod…
unsloth · Kit
Generates text from prompts as a 268M instruction-tuned Gemma 3 model in GGUF format, small enough for laptops and desktops. For developers who want a tiny loc…
sweepai · Kit
Predicts your next code edit from the open file, recent diffs and current state, running locally as a 1.5B Q8_0 GGUF model. For developers who want edit autoco…
Serveurperso · Kit
Speaks text in several languages with named speakers and Mandarin dialects, and can clone a voice from a short clip, through the qwentts.cpp C++ runtime on CPU…