Sweep Next-Edit 1.5B (GGUF)
sweepai · Kit
Predicts your next code edit from the open file, recent diffs and current state, running locally as a 1.5B Q8_0 GGUF model. For developers who want edit autoco…
New
AI projects from Hugging Face
Categories and filters
Listings
Unlimited-OCR-2-GGUF
RX5950XT · Kit
GGUF files of the Unlimited-OCR-2 document OCR model in BF16, Q8_0 and Q4_K_M, with a vision projector. They run only in a llama.cpp build with the repository'…
New
pplx-decider-flash-gguf-v1.2
perplexity-ai · Kit
Sorts a request into the choices you set, from text and images, using a Q8_0 GGUF copy of a small decision model. For developers who can run a protocol v3 runt…
New
Qwen2.5-Coder-1.5B Q8_0 GGUF
ggml-org · Kit
Runs Qwen2.5-Coder 1.5B on your own machine as a Q8_0 GGUF file through llama.cpp, from the command line or as a local server. It suits developers who want a s…
New
ConeML 1.2B Experimental
ConeML · Kit
Names the tallest, oldest or first item among facts you supply, as a small English research model in FP32 Safetensors and Q8_0 GGUF files. For researchers, non…
New
MOSS-Image-SFT GGUF
axiomofmind · Kit
Unofficial GGUF files of the MOSS-Image-SFT diffusion transformer in Q8_0 and Q4_K_S, for running text-to-image locally with stable-diffusion.cpp. Needs a sepa…
New
Qwen3-1.7B-GGUF
Qwen · Kit
Gives you the small Qwen3 1.7B chat model as a q8_0 GGUF file for llama.cpp, with a switch between thinking and non-thinking replies. For people who want a lig…
New
Qwen3-Reranker-0.6B-Q8_0-GGUF
ggml-org · Kit
Ranks passages by relevance to a query, as an 8-bit GGUF copy of the Qwen3 0.6B reranker made with llama.cpp. For developers who want a small local reranker fo…
New
Meta-Llama-3.1-8B-Instruct-GGUF
bartowski · Kit
Quantized GGUF files of Meta's Llama 3.1 8B Instruct for local chat, such as 4.92 GB for Q4_K_M and 8.54 GB for Q8_0. Made by bartowski with an importance matr…
New
Qwen3.8-27B-GGUF by bartowski
bartowski · Kit
A set of GGUF quantizations of Qwen3.8-27B by bartowski, from Q8_0 down to 3-bit, made with an importance matrix. For people running a 27B vision-language mode…
New
Qwen3.8-27B-QSA-GGUF
higa2515 · Kit
Runs Qwen3.8-27B with sparse attention from GGUF files in Q8_0 and Unsloth Q4, Q5 and Q6 mixes, with text, image and video input. For Linux users with NVIDIA G…
New
BotPsy-0.8B-GGUFs
qvac · Kit
GGUF copies of the 0.8B BotPsy tool-calling model in BF16, Q8_0 and Q4_K_M, for running agent and function-calling work fully on your own device with llama.cpp.
New