Qwen3.5-4B GGUF
bartowski · Kit
Imatrix GGUF quantizations of Qwen3.5-4B, a 4.3B image-text model with MTP layers, with the 4-bit file near 3 GB. For people who run a small model locally.
New
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
bartowski · Kit
Imatrix GGUF quantizations of Qwen3.5-4B, a 4.3B image-text model with MTP layers, with the 4-bit file near 3 GB. For people who run a small model locally.
JonathanColetti · Kit
Fixes the repeat loops that Qwen3.5-0.8B falls into in thinking mode by editing two weight tensors directly, with no training. A small image-text model for Tra…