Browse AI skills, agents and automations

Qwen3-30B-A3B-GGUF by unsloth

unsloth · Kit

GGUF files of Qwen3-30B-A3B, quantized by unsloth, for running a local chat and reasoning model in llama.cpp, Ollama or Open WebUI, with a thinking mode you ca…

Ornith-1.5-122B-NVFP4-DFlash2-RTX-Spark

Sherlock-Comms · Kit

Serves the 122B Ornith 1.5 model through vLLM with DFlash2 speculative decoding, using an unquantized output head. Made for RTX Spark laptops with 128 GB of me…

MiMo-V2.6-Distill-Qwen-9B-GSQ-RCO-GGUF

sainez · Kit

Gives you a 9B coding and tool-calling model as one 3.64 GiB GGUF file, quantized at about 3.5 bits per weight for running on your own machine.

Qwen3.8-27B-NVFP4 by RadixArk

RadixArk · Kit

A pre-quantized NVFP4 copy of Qwen3.8-27B that reads text, images and video and answers in text, served with SGLang on NVIDIA Blackwell GPUs. Suits developers…

Raptor-0.6-4B-JANG_6M

OsaurusAI · Kit

Decides when to call a tool, when to answer directly and when to ask first, tuned from a 4B model and quantized for Apple Silicon Macs running Osaurus. For peo…

Luciole-8B-Instruct-1.1-GGUF

OpenLLM-France · Kit

Quantized GGUF copy of Luciole-8B-Instruct-1.1, an 8B text generation model for French and English, for running on your own computer. From LINAGORA's work in t…

Nanbeige4.3-33B-INT4

Nanbeige · Kit

INT4 quantized version of Nanbeige4.3-33B, a 33B model for coding and professional agent tasks, made with quantization-aware training. For developers who want…

Qwen3.8-27B Fable-5 Coding Distilled GGUF

mradermacher · Kit

GGUF quantized files of a 27.3B coding-distilled Qwen3.8 model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit developers who run a cod…

OneJev1.6-4B-GGUF

mradermacher · Kit

Quantized GGUF copies of OneJev1.6-4B, from about 2 GB to 8.5 GB, for running the model on your own computer. The card does not say what the base model is for.

Z-Image-Turbo-GGUF by leejet

leejet · Kit

Generates images from text on modest GPUs, using quantized Z-Image-Turbo files made for stable-diffusion.cpp. For people who run image models on their own comp…

Qwen3.6-35B-A3B-2Bit-GSQ

ISTA-DASLab · Kit

A 2-bit quantized copy of Qwen3.6-35B-A3B made with GSQ, a Gumbel-Softmax method, that keeps most reasoning and coding ability at a much smaller memory footpri…

Gemma-3-12b-it-MAX-HORROR-Imatrix-GGUF

DavidAU · Kit

Writes fiction with a tint of horror. GGUF builds of Gemma 3 12B instruct, quantized with an imatrix made from a horror model, for creative writers who run mod…

Qwen3-ASR-1.7B GGUF

cstr · Kit

Turns speech, singing and songs into text, or into English, with quantized GGUF files of Qwen3-ASR-1.7B for CrispASR. For people who want local transcription a…

Qwen 3.6 35B-A3B REAP-48 v2 GGUF

crucible-labs · Kit

Runs a pruned and quantized Qwen3.6-35B-A3B in an 8.78 GiB GGUF file for llama.cpp, closer to the unquantized weights than the first release. For people with l…

Underdog-Woof-4B-1.1

ConwayResearch · Kit

Generates text as a compact 4.2B model, post-trained from Qwen 3 4B to work better with Underdog's own setup and quantized to 4-bit for MLX. For people running…

wan-gguf

calcuis · Kit

GGUF quantized versions of the Wan video models for text-to-video work in ComfyUI or diffusers, including small 1.3b files for older machines. For people who m…

MiniCPM5-2B-GGUF by bartowski

bartowski · Kit

Quantized GGUF copies of the MiniCPM5-2B text model in many sizes, made with llama.cpp and an importance matrix. For people running a small English and Chinese…

gugujiji_novel-humanize-4b-GGUF

bartowski · Kit

Quantized GGUF copies of the novel-humanize-4b Chinese text model, offered in sizes from full precision down to small files. For people who run a 4B-parameter…

granite-4.2-3b-GGUF

bartowski · Kit

Quantized GGUF copies of IBM's granite-4.2-3b text model, in many sizes from full precision down to small 3-bit files. For people who run a small chat model on…

google_gemma-4-31B-it-GGUF

bartowski · Kit

Quantized GGUF files of Google's Gemma 4 31B instruction model, from 17.15 GB to 61.41 GB, made by bartowski with an importance matrix. Reads images and text.…