AI skills and agents for developers

MiniCPM-OCR Jev GGUF

openbmb · Kit

Scores OCR readings of text, formula and table regions with a quality value between 0 and 1, in GGUF files for llama.cpp. For people who check OCR results on t…

Qwen3.5-0.8B-weight-space-programming-GGUF by NotCherry

NotCherry · Kit

Packages the Qwen3.5-0.8B weight-space-programming model as GGUF files for llama.cpp, with a 4-bit text model and a separate vision projector for image input.

Qwen3.8-27B-CodeForge-3xMerge i1 GGUF

mradermacher · Kit

Importance-matrix GGUF quants of the Qwen3.8-27B-CodeForge-3xMerge model, from about 11 GB to 22.5 GB, for local use. For people running 27B models on their ow…

Morphy1.1-Coder-Beta-7B-GGUF

moolvylabs · Kit

A 7.6B coding model from moolvylabs in GGUF form, released as a beta for testing and feedback. The card is short and gives no run steps, benchmarks or training…

Tess-4.5-27B GGUF

migtissera · Kit

GGUF builds of Tess-4.5, a 27B open-weights coding and agent model, for llama.cpp, with a vision projector and optional draft heads for faster generation. They…

Qwen3.6-35B-A3B lododo-Distill-v1.0 (GGUF)

lododoai · Kit

Runs as a local text model, a Qwen3.6-35B-A3B fine-tune trained on data written by Qwen3.8-27B and packed as one GGUF file for llama.cpp. For people who run mo…

Qwen3.8-27B-SLQ-GGUF

kaitchup · Kit

Compresses Qwen3.8-27B into three GGUF files with different size and fidelity levels, using a custom statistically lossless quantization. For people who run th…

Qwopus3.8-27B-Flash-V2-GGUF

Jackrong · Kit

Trims wasted reasoning in long agent tasks, as a GGUF build of the second Flash fine-tune of Qwen3.8-27B with better Python formatting. For people who run agen…

Ling-3.0-tiny-GGUF

inclusionAI · Kit

GGUF copy of inclusionAI's Ling-3.0-tiny, a small mixture-of-experts reasoning model with 7.9B total and 1.3B active parameters, for running locally at low cos…

K2-Horizon-7B-GGUF

IFM · Kit

Quantized GGUF copies of IFM's K2-Horizon-7B text model for running locally in llama.cpp, from BF16 down to 4-bit, with a 512K-token context window.

Qwen3.8-27B Intel Arc Tuned

Greatjedi · Kit

Runs a 27B Qwen3.8 model in GGUF files retuned for Intel Arc GPUs, with pure decode near 22 tokens a second in the author's tests. For people running llama.cpp…

phonon-31m English for audio.cpp

gradium · Kit

Speaks English text aloud on a CPU from a 31M text-to-speech model in GGUF form, for the audio.cpp runtime. Made for developers who want a small local voice mo…

Qwen3-Reranker-0.6B-Q8_0-GGUF

ggml-org · Kit

Ranks passages by relevance to a query, as an 8-bit GGUF copy of the Qwen3 0.6B reranker made with llama.cpp. For developers who want a small local reranker fo…

Laya-GGUF

ggml-org · Kit

Small 421M-parameter decision model in GGUF form that you serve locally and call through a systemone API. For developers who use llama.cpp tooling and want a c…

Kev-4B by ggml-org

ggml-org · Kit

Makes decisions through the /v1/systemone API of a llama server, from a GGUF copy of a 4.2B model. For developers who want a small local decision model.

gemma-4-E4B-it-GGUF by ggml-org

ggml-org · Kit

A GGUF-format copy of Google's gemma-4-E4B-it that you can run on your own computer with the Llama app or the llama serve command. For people who want Gemma ru…

gemma-4-12B-it GGUF

ggml-org · Kit

Runs Google's gemma-4-12B-it on your own computer as a GGUF file that ggml-org converted automatically, through the Llama app or the llama command. It suits pe…

DeepSeek-V4.1-Flash-1017 GGUF

ggml-org · Kit

GGUF files of DeepSeek's 748B V4.1 Flash 1017 model, converted by ggml-org with a vision file for images, for people with big-memory machines who run models th…

POCKET-35B-GGUF

FINAL-Bench · Kit

Runs a Korean-tuned 35B model on your own PC from GGUF files with llama.cpp, with a CPU-only path so no GPU is needed. For people who want a local language mod…

KVARK Sparkle 1.1 27B GGUF

Egzakta · Kit

Runs the 27B KVARK Sparkle 1.1 model from GGUF files in several sizes, with optional image input and speculative decoding. For people running models locally wi…