AI skills and agents for developers

Slonik-27B-oQ8-mtp

kakoka · Kit

Helps write and change PostgreSQL source code with a 27B coding model, 8-bit quantized to run locally on Apple Silicon Macs through oMLX. For PostgreSQL develo…

K2-Horizon-7B-GGUF

IFM · Kit

Quantized GGUF copies of IFM's K2-Horizon-7B text model for running locally in llama.cpp, from BF16 down to 4-bit, with a 512K-token context window.

Meta-Llama-3.1-8B-Instruct-GGUF

bartowski · Kit

Quantized GGUF files of Meta's Llama 3.1 8B Instruct for local chat, such as 4.92 GB for Q4_K_M and 8.54 GB for Q8_0. Made by bartowski with an importance matr…

Ornith-1.5-122B-NVFP4

ornith-ai · Kit

Gives you an NVFP4 quantized copy of Ornith-1.5-122B, a 122B mixture-of-experts text model meant for single-GPU use and strong in coding tests. For developers…

AREX-2 GGUF

mradermacher · Kit

GGUF quantized files of BAAI's AREX-2, a 26.9B model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit people who run a large model local…

Kromoss GGUF

molbal · Kit

GGUF quantized copies of Kromoss, a 1024 px text-to-image model fine-tuned from MOSS-Image-Base, for ComfyUI. For artists who want to generate images on a GPU…

RelayVSR X4 Quants

MATLOWAI · Kit

Pre-quantized Wan checkpoints for RelayVSR's 4x video upscaler, so it runs in ComfyUI on 16 GB and 24 GB graphics cards at 2560x1408 output, for video editors…

Axion-1.0-35B-APEX-I-MiniPlus-V2.1-GGUF

IsValorum · Kit

Runs the 35B Axion-1.0 model locally in llama.cpp from one compressed GGUF file with mixed precision. A quantized release by IsValorum for people who want a la…

Qwen3.8-27B-Randean-MXFP4

flechin · Kit

A 27B reasoning model tuned to answer plainly instead of hedging, quantized to MXFP4 so vLLM can serve it on a single 32 GB GPU, for developers who run local r…

Qwen3.6-35B-A3B GGUF (ShapeLearn Quantized)

byteshape · Kit

Quantized GGUF versions of Qwen3.6-35B-A3B that read images and text, with CPU and GPU variants from about 9 GB, made with ByteShape's ShapeLearn. For develope…

Hermes-3-Llama-3.1-8B-GGUF

NousResearch · Kit

Runs Hermes 3, an 8B general-purpose chat model from NousResearch, as a quantized GGUF file for llama.cpp. Suits people who want a local assistant with functio…

Qwen3.8-27B-exl3

turboderp · Kit

EXL3 quantized copies of Qwen3.8-27B in many bits-per-weight sizes, from 1.40 to 6.00. For people running the 27B model locally with ExLlamaV3 on limited GPU m…

DeepSeek-V4.1-Flash-1017-NVFP4

nvidia · Kit

NVIDIA's NVFP4 quantized copy of DeepSeek AI's DeepSeek-V4.1-Flash-1017, a huge multimodal mixture-of-experts model for NVIDIA Blackwell GPUs.

Qwen3.5 for ComfyUI

Comfy-Org · Kit

Repackaged Qwen3.5 2B, 4B and 9B model files for ComfyUI's text encoder folder, in bf16 and two quantized styles for the 9B size. For ComfyUI users who need a…

gemma-4-12b-it-GGUF

unsloth · Kit

Unsloth's GGUF quantized copy of Google's instruction-tuned Gemma 4 12B, a model that takes text, images, audio and video and writes text, for running locally.

Qwen3.6-35B-A3B-NVFP4

nvidia · Kit

A pre-quantized NVFP4 copy of Alibaba's Qwen3.6-35B-A3B, made by NVIDIA with Model Optimizer. It takes text, images and video, and runs on vLLM with Hopper or…

GLM-5.3-Flash-NVFP4

nvidia · Kit

Gives you NVIDIA's NVFP4 quantized copy of ZAI's GLM-5.3-Flash, a multimodal model for reasoning, coding and agent tasks. Meant for developers who deploy on Bl…

Qwen3-8B-GGUF

Qwen · Kit

Runs Qwen3-8B as quantized GGUF files in llama.cpp or Ollama, with a thinking mode for math, code and logic and a plain mode for chat. For people who want a lo…

whisper.cpp

ggerganov · Kit

OpenAI's Whisper speech recognition models converted to ggml files for whisper.cpp, in sizes from tiny to large-v3-turbo, with smaller quantized copies.

Qwen3.5-4B-GGUF

unsloth · Kit

Unsloth's GGUF quantized copy of Qwen3.5-4B, a small model that reads images and text and answers in text, for people running models locally.