gemma-4-26B-A4B-it Cactus CQ
Cactus-Compute · Kit
2-bit, 3-bit and 4-bit compressed copies of Google's gemma-4-26B-A4B-it chat model in the Cactus weights format. Built to run on ARM devices through the Cactus…
New
AI skills and agents for developers
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Categories and filters
Listings
Llama-3.2-3B-Instruct-GGUF by unsloth
unsloth · Kit
Chats, summarizes and answers questions with Meta's compact Llama 3.2 3B instruct model, in GGUF files by Unsloth from 2-bit up to 16-bit. Small enough for ord…
New
Qwen3.8-27B Fable-5 Coding Distilled GGUF
mradermacher · Kit
GGUF quantized files of a 27.3B coding-distilled Qwen3.8 model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit developers who run a cod…
New
Qwen3.6-35B-A3B-2Bit-GSQ
ISTA-DASLab · Kit
A 2-bit quantized copy of Qwen3.6-35B-A3B made with GSQ, a Gumbel-Softmax method, that keeps most reasoning and coding ability at a much smaller memory footpri…
New
DeepSeek V4.1 Flash GGUF for DwarfStar
antirez · Kit
Gives Mac users calibrated 2-bit and 4-bit GGUF files of DeepSeek V4.1 Flash, plus a separate vision encoder, for DwarfStar's Metal engine with SSD streaming.…
New
Llama-3.2-1B-Instruct-GGUF
unsloth · Kit
Chats, summarizes and answers questions in text on a laptop, as Unsloth's GGUF copy of Meta's small Llama 3.2 1B Instruct in precisions from 16-bit to 2-bit. F…
New
AREX-2 GGUF
mradermacher · Kit
GGUF quantized files of BAAI's AREX-2, a 26.9B model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit people who run a large model local…
New
Runs a pruned, 2-bit DeepSeek-V4.1-Flash on a 128 GB Mac through mlx-serve, keeping 192 of 384 experts and a 1M-token context. Strongest on code, reasoning and…
New
Qwen3.6-35B-A3B 2-bit GSQ GGUF
chtisgit · Kit
Runs a 35B Qwen model in a 2-bit GSQ GGUF conversion with a separate vision projector for llama.cpp. For people who want a large model in a small file on CPU o…
New