AI skills and agents for developers

gemma-4-26B-A4B-it Cactus CQ

Cactus-Compute · Kit

2-bit, 3-bit and 4-bit compressed copies of Google's gemma-4-26B-A4B-it chat model in the Cactus weights format. Built to run on ARM devices through the Cactus…

Sarvam-105B GGUF

sarvamai · Kit

The GGUF version of Sarvam-105B, a large mixture-of-experts model with a focus on Indian languages, split into 9 shards at 4-bit for llama.cpp. For people with…

Flint INT4

RecursiveSI · Kit

A 4-bit MLX copy of Recursive Flint for local use on Apple Silicon, about 22.6 GB, launched through Rec with pi or OpenCode. Suits Mac users and developers who…

Qwen2.5-7B-Instruct-AWQ

Qwen · Kit

A 4-bit AWQ build of Qwen2.5-7B-Instruct, a 7.6B chat model that follows instructions, handles tables and returns JSON. For developers who want a capable chat…

Qwen3.8-27B-QUASAR-NVFP4

QUASAR-QAT · Kit

Runs Qwen3.8-27B in 4-bit NVFP4 at 19.7 GB, trained with the QUASAR method to stay close to the full BF16 model. For people serving it with vLLM on an NVIDIA B…

Qwen3.6-35B-A3B-4bit

mlx-community · Kit

A 4-bit MLX conversion of Qwen3.6-35B-A3B that answers text and image prompts on Apple Silicon Macs. Made for people who want to run this Qwen model locally wi…

JevK5-chat-mlx-4bit

mlx-community · Kit

A 4-bit MLX copy of the 4.2B JevK5 chat model for Apple Silicon, with a 262,144 token context and a small memory footprint. Made for Mac users who want a quick…

clef-flash-4bit

mlx-community · Kit

A 4-bit MLX copy of Cloudflare's clef-flash that turns a state and typed questions into a probability for every allowed answer on Apple Silicon Macs. Not a cha…

GLM-5.3-Flash EXL3 4bpw for TensorFold

Mia-AiLab · Kit

4-bit EXL3 quantization of GLM-5.3-Flash prepared for TensorFold, with lower KL divergence than a popular TR3-4bpw quant at the same size. For people serving l…

Granite-4.2-3B (GGUF)

ibm-granite · Kit

Packages IBM's Granite 4.2 3B text model as GGUF files for local use. The 4-bit weights are estimated at about 1.8 GB, for people who want a compact model unde…

gemma-4-31B-it-qat-q4_0-gguf

google · Kit

Runs Google's Gemma 4 31B instruction-tuned model as a 4-bit GGUF file that reads text and images and answers in text. It suits developers and enthusiasts with…

Qwen3.8-27B Splash 8-bit

dmeight · Kit

Runs Qwen3.8-27B at 8-bit through the Splash runtime in LM Studio on Apple silicon. An unofficial package that keeps the model closer to the original than the…

Underdog-Woof-4B-1.1

ConwayResearch · Kit

Generates text as a compact 4.2B model, post-trained from Qwen 3 4B to work better with Underdog's own setup and quantized to 4-bit for MLX. For people running…

Qwen3.5-4B GGUF

bartowski · Kit

Imatrix GGUF quantizations of Qwen3.5-4B, a 4.3B image-text model with MTP layers, with the 4-bit file near 3 GB. For people who run a small model locally.

Llama-3.2-1B-Instruct GGUF

bartowski · Kit

GGUF quantizations of Llama-3.2-1B-Instruct, a 1.2B text model in eight languages, with the 4-bit file near 0.8 GB. For people who run a tiny local model.

Qwen3.8-Whittle-MoE-27B-MLX-4bit

barozp · Kit

A 4-bit MLX build for Apple Silicon of a mixture-of-experts model carved from the dense Qwen3.8-27B, with 17.8B active of 27B total parameters. For people who…

gemma-4-31B-it-qat-GGUF

unsloth · Kit

Runs Google's Gemma 4 31B instruction model from Unsloth's 4-bit QAT GGUF files, with an included drafter for faster speculative decoding in llama.cpp. For peo…

Flint NVFP4 GGUF

RecursiveSI · Kit

A 4-bit NVFP4 copy of the Recursive Flint text model as one GGUF file, built for NVIDIA GPUs through llama.cpp. For developers running a large local model with…

Qwen3.5-0.8B-weight-space-programming-GGUF by NotCherry

NotCherry · Kit

Packages the Qwen3.5-0.8B weight-space-programming model as GGUF files for llama.cpp, with a 4-bit text model and a separate vision projector for image input.

Qwen3.5-9B-OptiQ-4bit

mlx-community · Kit

A 4-bit mixed-precision MLX version of Qwen3.5-9B for local text generation on Apple Silicon, with a bundled multi-token prediction head. For Mac users who run…