Laya-GGUF
ggml-org · Kit
Small 421M-parameter decision model in GGUF form that you serve locally and call through a systemone API. For developers who use llama.cpp tooling and want a c…
New
AI skills and agents for developers
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Categories and filters
Listings
Kev-4B by ggml-org
ggml-org · Kit
Makes decisions through the /v1/systemone API of a llama server, from a GGUF copy of a 4.2B model. For developers who want a small local decision model.
New
gemma-4-E4B-it-GGUF by ggml-org
ggml-org · Kit
A GGUF-format copy of Google's gemma-4-E4B-it that you can run on your own computer with the Llama app or the llama serve command. For people who want Gemma ru…
New
gemma-4-12B-it GGUF
ggml-org · Kit
Runs Google's gemma-4-12B-it on your own computer as a GGUF file that ggml-org converted automatically, through the Llama app or the llama command. It suits pe…
New
POCKET-35B-GGUF
FINAL-Bench · Kit
Runs a Korean-tuned 35B model on your own PC from GGUF files with llama.cpp, with a CPU-only path so no GPU is needed. For people who want a local language mod…
New
GLiNER2.5 Multi
fastino · Kit
Pulls entities, labels, structured records and relations out of text with one multilingual model. A 287M-parameter extractor from fastino that runs locally on…
New
KVARK Sparkle 1.1 27B GGUF
Egzakta · Kit
Runs the 27B KVARK Sparkle 1.1 model from GGUF files in several sizes, with optional image input and speculative decoding. For people running models locally wi…
New
Kvark-Sparkle-1.0-27B-GGUF
Egzakta · Kit
GGUF files of KVARK Sparkle 1.0, a 27B vision-language model, for llama.cpp, Ollama and LM Studio, with the speculative-decoding head kept. For people running…
New
GGUF fine-tune of a 27B Qwen model by DavidAU, with switchable instruct and reasoning modes and a built-in help system. Hugging Face lists it as image text to…
New
Answers questions and reads images with much shorter thinking. GGUF builds of a 27B Qwen 3.8 tune from DavidAU that aims to cut reasoning tokens while keeping…
New
Maximizing Model Performance Guide
DavidAU · Kit
Guides you in tuning samplers and parameters for local language models, with steps for system prompts, reasoning models and expert settings in LM Studio, Silly…
New
Qwen3.8-27B iMatrix NVFP4 MTP GGUF
cdiamond · Kit
A 17.1 GB mixed-precision GGUF of Qwen3.8-27B that keeps its multi-token prediction layer, tuned for 256K context with vision on a 24 GB GPU. For people who ru…
New
Qwen3.6-35B-A3B MTP GGUF
byteshape · Kit
Runs Qwen3.6-35B-A3B from a GGUF quantization with Multi-Token Prediction for faster GPU decoding in llama.cpp. Made by ByteShape for people running local mode…
New
Meta-Llama-3.1-8B-Instruct-GGUF
bartowski · Kit
Quantized GGUF files of Meta's Llama 3.1 8B Instruct for local chat, such as 4.92 GB for Q4_K_M and 8.54 GB for Q8_0. Made by bartowski with an importance matr…
New
Llama-3.2-3B-Instruct-GGUF
bartowski · Kit
GGUF quantizations of Meta's Llama-3.2-3B-Instruct, made by bartowski with an importance matrix, from about 1.8 GB to 6.4 GB. For running a small chat model lo…
New
KAT-Coder-V2.5-Dev GGUF
bartowski · Kit
Imatrix GGUF quantizations of Kwaipilot's KAT-Coder-V2.5-Dev, a 34.7B text model, with 4-bit files of about 19 GB or more. For people who run a large coder-nam…
New
Spark-X2.6-1.7B-DSpark-GGUF
XHToken · Kit
A small draft model that speeds up Spark-X2.6-1.7B through speculative decoding, guessing up to seven tokens per step. For people who run that model locally on…
New
gemma-4-E2B-it-GGUF
unsloth · Kit
Unsloth's GGUF files of Google DeepMind's Gemma 4 E2B instruction-tuned model, which takes text and images and writes text, with a 128K context. For people who…
New
gemma-3-4b-it-GGUF
unsloth · Kit
Answers questions about text and images on your own computer, as a GGUF copy of Google's Gemma 3 4B instruction model packaged by Unsloth. For developers and u…
New
OmniVoice GGUF
Serveurperso · Kit
Provides GGUF weights of the OmniVoice text-to-speech model for the omnivoice.cpp runtime, with voice design and voice cloning examples. For developers who wan…
New