Qwen3-Reranker-0.6B-Q8_0-GGUF
ggml-org · Kit
Ranks passages by relevance to a query, as an 8-bit GGUF copy of the Qwen3 0.6B reranker made with llama.cpp. For developers who want a small local reranker fo…
New
AI skills and agents for developers
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Categories and filters
No listing has every word of “llada”. Showing what matches “llama” instead.
Listings
Laya-GGUF
ggml-org · Kit
Small 421M-parameter decision model in GGUF form that you serve locally and call through a systemone API. For developers who use llama.cpp tooling and want a c…
New
Kev-4B by ggml-org
ggml-org · Kit
Makes decisions through the /v1/systemone API of a llama server, from a GGUF copy of a 4.2B model. For developers who want a small local decision model.
New
gemma-4-E4B-it-GGUF by ggml-org
ggml-org · Kit
A GGUF-format copy of Google's gemma-4-E4B-it that you can run on your own computer with the Llama app or the llama serve command. For people who want Gemma ru…
New
gemma-4-12B-it GGUF
ggml-org · Kit
Runs Google's gemma-4-12B-it on your own computer as a GGUF file that ggml-org converted automatically, through the Llama app or the llama command. It suits pe…
New
DeepSeek-V4.1-Flash-1017 GGUF
ggml-org · Kit
GGUF files of DeepSeek's 748B V4.1 Flash 1017 model, converted by ggml-org with a vision file for images, for people with big-memory machines who run models th…
New
POCKET-35B-GGUF
FINAL-Bench · Kit
Runs a Korean-tuned 35B model on your own PC from GGUF files with llama.cpp, with a CPU-only path so no GPU is needed. For people who want a local language mod…
New
KVARK Sparkle 1.1 27B GGUF
Egzakta · Kit
Runs the 27B KVARK Sparkle 1.1 model from GGUF files in several sizes, with optional image input and speculative decoding. For people running models locally wi…
New
Kvark-Sparkle-1.0-27B-GGUF
Egzakta · Kit
GGUF files of KVARK Sparkle 1.0, a 27B vision-language model, for llama.cpp, Ollama and LM Studio, with the speculative-decoding head kept. For people running…
New
Maximizing Model Performance Guide
DavidAU · Kit
Guides you in tuning samplers and parameters for local language models, with steps for system prompts, reasoning models and expert settings in LM Studio, Silly…
New
Qwen3.8-27B iMatrix NVFP4 MTP GGUF
cdiamond · Kit
A 17.1 GB mixed-precision GGUF of Qwen3.8-27B that keeps its multi-token prediction layer, tuned for 256K context with vision on a 24 GB GPU. For people who ru…
New
Qwen3.6-35B-A3B MTP GGUF
byteshape · Kit
Runs Qwen3.6-35B-A3B from a GGUF quantization with Multi-Token Prediction for faster GPU decoding in llama.cpp. Made by ByteShape for people running local mode…
New
Meta-Llama-3.1-8B-Instruct-GGUF
bartowski · Kit
Quantized GGUF files of Meta's Llama 3.1 8B Instruct for local chat, such as 4.92 GB for Q4_K_M and 8.54 GB for Q8_0. Made by bartowski with an importance matr…
New
Llama-3.2-3B-Instruct-GGUF
bartowski · Kit
GGUF quantizations of Meta's Llama-3.2-3B-Instruct, made by bartowski with an importance matrix, from about 1.8 GB to 6.4 GB. For running a small chat model lo…
New
Forge-1-Gemma-4-E2B
YoSaNoo · Kit
A small coding-minded text model fine-tuned from Google's gemma-4-E2B and shared as GGUF files, so you can run it on your own laptop in Ollama, LM Studio, Unsl…
New
Spark-X2.6-1.7B-DSpark-GGUF
XHToken · Kit
A small draft model that speeds up Spark-X2.6-1.7B through speculative decoding, guessing up to seven tokens per step. For people who run that model locally on…
New
Llama-3.2-1B-Instruct-GGUF
unsloth · Kit
Chats, summarizes and answers questions in text on a laptop, as Unsloth's GGUF copy of Meta's small Llama 3.2 1B Instruct in precisions from 16-bit to 2-bit. F…
New
Qwen3-4B-GGUF
Qwen · Kit
A 4B chat model in GGUF format that runs locally in llama.cpp or ollama, with a thinking mode for reasoning and a plain mode for quick replies. Suits developer…
New
Qwen2.5-Coder-14B-Instruct-GGUF
Qwen · Kit
Gives you the Qwen2.5-Coder 14B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp. For developers who want a stronger lo…
New
Qwen2.5-Coder-1.5B-Instruct-GGUF
Qwen · Kit
Gives you the small Qwen2.5-Coder 1.5B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp on a laptop. For developers who…
New