Qwen3.5-9B-GGUF
unsloth · Kit
Unsloth's GGUF quantized copy of Qwen3.5-9B, a mid-size model that reads images and text and answers in text, for people running models locally.
New
AI skills and agents for developers
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Categories and filters
Listings
Qwen3.8-27B-FP8
Qwen · Kit
Handles text, images and video with FP8-quantized weights of Qwen3.8-27B, a 27B dense model with adjustable thinking. For developers serving it with transforme…
New
Ripple-65B-Preview-GGUF
AtomicChat · Kit
GGUF quantized files of the 65B Ripple Preview agentic-coding model, for running locally with llama.cpp. For people who run large open models on their own hard…
New
Qwen3.8-27B GGUF (ShapeLearn Quantized)
byteshape · Kit
Runs Qwen3.8-27B as GGUF files quantized by ByteShape's ShapeLearn, in five GPU-sized options with vision input and MTP speculative decoding in llama.cpp. For…
New
DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF
ISTA-DASLab · Kit
GGUF versions of DeepSeek-V4.1-Flash-1017 at three small sizes, with each tensor quantized at its own precision. For people running a huge mixture-of-experts m…
New
Qwen3.8-Flash-Next-GSQ-RCO-GGUF
ISTA-DASLab · Kit
GGUF versions of Qwen3.8-Flash-Next at four sizes, with each tensor quantized at its own precision and a vision projector for image input. For people running a…
New
DeepSeek-V4.1-Flash-1017-GSQ-RCO-Coder-GGUF
ISTA-DASLab · Kit
An expert pruned and quantized GGUF of DeepSeek-V4.1-Flash-1017 from ISTA-DASLab, aimed at code and agent work, with transformer weights of 72.1 GB. Suits deve…
New
Qwen3.8-27B-GSQ-RCO-GGUF
ISTA-DASLab · Kit
ISTA-DASLab's GGUF versions of Qwen3.8-27B in four sizes, each tensor quantized at its own precision, with a vision projector for images. Suits people who run…
New
Local Model Explorer
LocalLLaMA · Kit
Shows which GGUF quantized models fit your graphics card, Mac or CPU, for people who run language models on their own machine and want to pick a file that work…
New
GGUF Model VRAM Calculator
DavidAU · Kit
Estimates how much video memory a GGUF model needs, in a static page that runs in your browser. Suits people choosing a quantized model that fits their graphic…
New