AI skills and agents for developers

Qwen3.8-Flash-Next-125B-UltraLite-37GiB-GGUF

0xKitkat · Kit

Squeezes the Qwen3.8-Flash-Next mixture-of-experts model into about 37 GiB of text-only GGUF files for experiments. It needs a patched llama.cpp build that com…

Strata-Sage-A1.5-GGUF

ykarout · Kit

A Q4_K_M GGUF of the 35B Sage-A1.5 model made for the Strata inference engine, fitting a full 262K context on a 16 GB graphics card plus 64 GB of RAM. For peop…

OpenBonsai Qwen3.5-9B Ternary

webbrain-one · Kit

Runs Qwen3.5-9B squeezed to ternary weights in a roughly 2 GB GGUF file, for CPU use in two llama.cpp variants. A research preview for people who experiment wi…

Granite Speech 5.0 TurboCTC 470M GGUF

vladers · Kit

Converts speech to text in seven languages, as quantized GGUF versions of IBM's Granite Speech 5.0 TurboCTC 470M, built for transcribe.cpp. For developers addi…

Z-Image-Turbo-GGUF by unsloth

unsloth · Kit

Unsloth's GGUF files of Z-Image-Turbo, a fast distilled text-to-image model that the authors say fits on a 16 GB consumer GPU. For people who generate images l…

Qwen3.6-27B-MTP-GGUF

unsloth · Kit

Codes and reasons with Qwen3.6 27B in GGUF files by Unsloth that carry multi-token prediction, which the card says speeds up replies about 1.5 to 2 times with…

Qwen3.5-0.8B-MTP-GGUF

unsloth · Kit

Runs the small Qwen3.5 0.8B vision-language model in llama.cpp with multi-token prediction for faster generation, as Unsloth's GGUF files. For developers testi…

Muse Glimmer 30B GGUF

unsloth · Kit

Runs a 30B agent model locally that reads text and images, calls tools and retries failed calls, from Unsloth's GGUF files. For developers building local agent…

granite-4.1-8b-GGUF

unsloth · Kit

Follows instructions, calls tools and chats with IBM's Granite 4.1 8B model, in GGUF files by Unsloth that include chat template fixes. Made for business assis…

gemma-4-31B-it-qat-GGUF

unsloth · Kit

Runs Google's Gemma 4 31B instruction model from Unsloth's 4-bit QAT GGUF files, with an included drafter for faster speculative decoding in llama.cpp. For peo…

YuE2-GGUF

Serveurperso · Kit

Pre-quantized GGUF files for yue2.cpp, a C++ song generator that turns style tags and lyrics into stereo audio plus the score it composed. For musicians and ti…

Haas-ja-v1.0-GGUF

sakasegawa · Kit

GGUF files of a Japanese speech recognition model that run only in speech.cpp, on macOS, Windows, Linux or the CPU alone. For people who transcribe Japanese au…

Flint NVFP4 GGUF

RecursiveSI · Kit

A 4-bit NVFP4 copy of the Recursive Flint text model as one GGUF file, built for NVIDIA GPUs through llama.cpp. For developers running a large local model with…

Qwen3-Embedding-0.6B-GGUF

Qwen · Kit

Turns text into number vectors for search, retrieval and clustering in more than 100 languages, as a 0.6B model in GGUF format. Suits developers building searc…

Qwen3-1.7B-GGUF

Qwen · Kit

Gives you the small Qwen3 1.7B chat model as a q8_0 GGUF file for llama.cpp, with a switch between thinking and non-thinking replies. For people who want a lig…

Xiaomi-OCR-0-GGUF

prithivMLmods · Kit

Provides GGUF files of Xiaomi-OCR-0, a compact 0.8B vision-language model for reading documents and text in images, in sizes from about 466 MB to 1.52 GB. For…

Bonsai-1.7B-GGUF

prism-ml · Kit

Generates text with a 1.7B language model packed to 1 bit per weight, about 0.24 GB, for llama.cpp on CUDA, Metal and CPU. For developers who need a tiny local…

Qwen3.8-27B-QSA-GSQ-RCO-GGUF

pentacoxian-dev · Kit

Runs Qwen3.8-27B with sparse attention on a single 24 GB GPU at a 262K-token context with image input, as GGUF files for people with a custom llama.cpp engine…

Ornith-1.0-9B-GGUF

ornith-ai · Kit

GGUF copy of a 9B open-source coding-agent model, trained with reinforcement learning to write solutions and the scaffolding around them. Built for single-GPU…

MiniCPM-V-4.7-1B-gguf

openbmb · Kit

Runs a 1B vision-language model through llama.cpp, answering text prompts about images. GGUF files in many quant sizes, for developers and hobbyists who want a…