AI skills and agents for developers

GLM-5.3-Flash EXL3 3.5bpw

Mia-AiLab · Kit

Quantized copy of GLM-5.3-Flash in EXL3 format, 156 GB, with narrower routed experts, about 11 percent smaller than the same lab's 4-bit version. For people ru…

K2-Horizon-7B-GGUF

IFM · Kit

Quantized GGUF copies of IFM's K2-Horizon-7B text model for running locally in llama.cpp, from BF16 down to 4-bit, with a 512K-token context window.

Hydrogen-1.0 NVFP4

deep-principle · Kit

A 4-bit NVFP4 build of Hydrogen-1.0, a 381B science and research assistant model from Deep Principle, based on GLM-5.3. It needs a multi-GPU NVIDIA Blackwell s…

Qwen3.8-27B-AWQ-INT4

cyankiwi · Kit

A 4-bit AWQ quantization of Qwen3.8-27B by cyankiwi, a 27B vision-language model with thinking control. Weights are 21.02 GB and load in Transformers, vLLM or…

KAT-Coder-V2.5-Dev GGUF

bartowski · Kit

Imatrix GGUF quantizations of Kwaipilot's KAT-Coder-V2.5-Dev, a 34.7B text model, with 4-bit files of about 19 GB or more. For people who run a large coder-nam…

DeepSeek V4.1 Flash GGUF for DwarfStar

antirez · Kit

Gives Mac users calibrated 2-bit and 4-bit GGUF files of DeepSeek V4.1 Flash, plus a separate vision encoder, for DwarfStar's Metal engine with SSD streaming.…

MNN-Pocket-0.3B-MNN

taobao-mnn · Kit

Runs a 0.3B Chinese and English chat model on phones and edge devices through the MNN runtime, as a 4-bit build of about 173 MB. For developers adding on-devic…

Qwen3.8-27B-Splash

incoai · Kit

Serves Qwen3.8-27B on Apple silicon Macs through Inco AI's Splash engine, with a 4-bit model, a DFlash 2 draft and a vision encoder in one package. Works only…

Qwen3-VL for ComfyUI

Comfy-Org · Kit

Repackaged Qwen3-VL 4B and 8B model files for ComfyUI's text encoder folder, offered in several precisions from bf16 to 4-bit styles. For ComfyUI users who nee…

Wan2.2 TI2V 5B GGUF

QuantStack · Kit

A 5B-parameter text-to-video model converted to GGUF for ComfyUI, about 2.5 GB at 4-bit by estimate, for English and Chinese prompts. It suits ComfyUI users wh…

Qwen3.8-27B-4bit (MLX)

mlx-community · Kit

4-bit MLX conversion of Qwen3.8-27B that reads text and images and answers in text, run with the mlx-vlm tool. For developers who want to run a vision-language…

gemma-4-12B-it-qat-q4_0-gguf

google · Kit

Runs Google's Gemma 4 12B instruction-tuned model in a 4-bit GGUF file made with quantization-aware training. Reads text and images, and suits laptops and cons…

gemma-4-E4B-it-GGUF

unsloth · Kit

A 4-bit GGUF copy of Google's Gemma 4 E4B instruction model, packaged by Unsloth for running on your own machine. It reads text and images and answers in text.

Spark-X2.6-1.7B-GGUF

XHToken · Kit

Runs a small 1.7B on-device language model from XHToken as 4-bit GGUF files, for chat, coding and agent tasks in English and Chinese, with adjustable thinking…

gemma-4-12B-it-qat-GGUF

unsloth · Kit

Gemma 4 12B in GGUF form, trained with quantization-aware training so a 4-bit copy keeps near-bfloat16 quality. For people running Gemma locally with llama.cpp…

Qwen3.8-27B-NVFP4

unsloth · Kit

A 4-bit NVFP4 copy of the Qwen3.8 27B vision-language model made by Unsloth, for serving with vLLM. For developers who want a dense model that reads images and…

Qwen3.8-27B NVFP4

nvidia · Kit

NVIDIA's 4-bit NVFP4 build of Alibaba's Qwen3.8-27B, made with Model Optimizer for Blackwell GPUs, taking text, image and video in and giving text back.

Raon-1 nano (LiteRT-LM)

KRAFTON · Kit

Packs Raon-1 nano as a 4-bit LiteRT-LM bundle with a 4,096-token context, for running a Korean and English chat model on devices. Replies come without a thinki…

Thinklite-27B-GGUF

Sparset · Kit

A 4-bit GGUF copy of Thinklite-27B for llama.cpp that uses less reasoning per answer than its base model, for people running a 27B text model locally.

Raon-1 nano (MLX)

KRAFTON · Kit

Provides Raon-1 nano as 4-bit MLX weights for Apple silicon, so developers can run a Korean and English chat model locally on a Mac. For app builders and local…