Swift 1.5 Ornith 9B GGUF
ukisai · Kit
Runs Swift 1.5 Ornith 9B, a reasoning model tuned to think with fewer tokens, as GGUF quantizations for llama.cpp. For people who run a 9B reasoning model on t…
New
AI skills and agents for developers
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Categories and filters
No listing has every word of “mllama”. Showing what matches “llama” instead.
Listings
Groot-19B-A3B-TTQ-GGUF
TokenTinkerer · Kit
Offers eleven GGUF sizes of the Groot-19B-A3B reasoning model for llama.cpp, from 7.88 to 18.59 GiB, plus a vision projector. Made for people who run the model…
New
Qwen3.8-27B-DFlash2-GGUF by z-lab
z-lab · Kit
A draft model in GGUF form that speeds up Qwen3.8-27B by proposing token blocks for the main model to verify. For people who run that model locally with llama.…
New
LocalAlign_llama3.1_8B
yuyangGong · Kit
A LoRA adapter for Llama-3.1-8B-Instruct that trains it to follow trusted instructions and ignore commands hidden in external data. A prompt injection defense…
New
Qwen3.5-4B-MTP-GGUF
unsloth · Kit
Unsloth's GGUF files of Qwen3.5-4B with multi-token prediction, which lets llama.cpp use speculative decoding for roughly 1.5 to 2 times faster generation. For…
New
Qwen3-30B-A3B-GGUF by unsloth
unsloth · Kit
GGUF files of Qwen3-30B-A3B, quantized by unsloth, for running a local chat and reasoning model in llama.cpp, Ollama or Open WebUI, with a thinking mode you ca…
New
Llama-3.2-3B-Instruct-GGUF by unsloth
unsloth · Kit
Chats, summarizes and answers questions with Meta's compact Llama 3.2 3B instruct model, in GGUF files by Unsloth from 2-bit up to 16-bit. Small enough for ord…
New
Clef-LoRA-for-Qwen3.8-27B-GGUF
trevest · Kit
Adds Cloudflare Clef's decision head to a Qwen3.8-27B chat model, so one llama.cpp server on a 24 GB GPU both answers typed questions and chats. It is a LoRA a…
New
Sarvam-105B GGUF
sarvamai · Kit
The GGUF version of Sarvam-105B, a large mixture-of-experts model with a focus on Indian languages, split into 9 shards at 4-bit for llama.cpp. For people with…
New
Unlimited-OCR-2-GGUF
RX5950XT · Kit
GGUF files of the Unlimited-OCR-2 document OCR model in BF16, Q8_0 and Q4_K_M, with a vision projector. They run only in a llama.cpp build with the repository'…
New
Qwen3-30B-A3B-GGUF
Qwen · Kit
A 30.5B mixture-of-experts chat model in GGUF format with only 3.3B parameters active per token, runnable in llama.cpp or ollama. It has thinking and plain mod…
New
Qwen3-0.6B-GGUF
Qwen · Kit
A small 0.6B chat model in GGUF format that runs locally in llama.cpp or ollama and can switch between thinking and plain replies. Suits people with modest har…
New
Qwen2.5-Coder-32B-Instruct-GGUF
Qwen · Kit
GGUF copy of a 32B code chat model that runs locally with llama.cpp. It writes, explains and fixes code from plain requests, for developers who want to run it…
New
nomic-embed-text-v1.5-GGUF
nomic-ai · Kit
Turns sentences into vectors on your own machine through llama.cpp, using compact GGUF files, for search and RAG questions. For developers who want local text…
New
Qwen3.8-Flash-Next-DFlash2-GGUF
nazeshinjite · Kit
GGUF draft model that speeds up Qwen3.8-Flash-Next in llama.cpp through speculative decoding, in 334 MiB and 622 MiB files. It is not a standalone model, and i…
New
Muse Glimmer 30B GGUF by meta-models
meta-models · Kit
GGUF builds of a 30-billion-parameter agentic model for llama.cpp, with an optional image encoder and a speculative decoding drafter. They suit people who run…
New
askmdb-9b-GGUF
manuelgscom · Kit
Writes a read-only MongoDB aggregate pipeline from a plain Spanish or English question. A GGUF copy of a Qwen3.5-9B fine-tune that runs locally with llama.cpp,…
New
tinyllamas
karpathy · Kit
Provides a series of small language models in the Llama 2 design, trained on the TinyStories dataset and made for Karpathy's llama2.c project. For developers w…
New
Qwen3.8-Flash-Coder APEX-I-MiniPlus V2.1 GGUF
IsValorum · Kit
An English-only coding model in GGUF, a 42.6B mixture-of-experts quant of about 21.8 GB, for code completion, refactoring and agentic tool calls in llama.cpp o…
New
K2-Horizon-3.7B-GGUF
IFM · Kit
GGUF files of the 3.7B K2-Horizon text model in six precision levels, from BF16 to Q4_K_M, for running with llama.cpp. The model has a 512K-token context windo…
New