Ornith-1.5-35B-A3B-GSQ-RCO-GGUF
pfeifferj · Kit
Shrinks the Ornith-1.5-35B-A3B text model to 3-bit and 3.5-bit GGUF files, about 13 and 15 GB instead of 69 GB, for people who run local models with llama.cpp.
New
Kits of AI agent skills, rules and prompts
Categories and filters
No listing has every word of “mllama”. Showing what matches “llama” instead.
Listings
ttf-Qwen3.8-Flash-Next-GGUF
oguzeldereli · Kit
Runs Qwen3.8-Flash-Next, a 180B mixture-of-experts model squeezed to ternary weights, from one 40.4 GB GGUF file that is 4.6 times smaller than the FP8 release…
New
Hermes-3-Llama-3.1-8B-GGUF
NousResearch · Kit
Runs Hermes 3, an 8B general-purpose chat model from NousResearch, as a quantized GGUF file for llama.cpp. Suits people who want a local assistant with functio…
New
Hermes 3 Llama-3.1 8B
NousResearch · Kit
An 8B general-purpose chat model from Nous Research, built on Llama 3.1, with function calling, structured output, role play and code help. It suits developers…
New
Qwen3.8-27B-GGUF by bartowski
bartowski · Kit
A set of GGUF quantizations of Qwen3.8-27B by bartowski, from Q8_0 down to 3-bit, made with an importance matrix. For people running a 27B vision-language mode…
New
Jackrong_Qwopus3.8-27B-Coder-Flash-GGUF
bartowski · Kit
GGUF quantizations of Jackrong's Qwopus3.8-27B-Coder-Flash, made by bartowski with an importance matrix, in sizes from 17 GB to 55 GB. For running a 27B model…
New
Qwen3.5-9B-MTP-GGUF
unsloth · Kit
GGUF copies of Qwen3.5 9B that support multi-token-prediction speculative decoding in llama.cpp for faster generation. For people running the model locally who…
New
Qwen3.8-27B-exl3
turboderp · Kit
EXL3 quantized copies of Qwen3.8-27B in many bits-per-weight sizes, from 1.40 to 6.00. For people running the 27B model locally with ExLlamaV3 on limited GPU m…
New
Bonsai-27B-gguf
prism-ml · Kit
Runs a 27B-class reasoning model as a 1-bit GGUF file of about 3.9 GB for llama.cpp, so it fits a laptop or one GPU. For people who want local reasoning on eve…
New
DeepSeek-V4.1-Flash-1017 EXL3 EAQ v1 2.9 bpw
Mia-AiLab · Kit
A 2.9 bits-per-weight EXL3 quantization of DeepSeek-V4.1-Flash-1017 that reads text and images. It cuts the model to about 210 GB for exllamav3 runtimes, and t…
New
Qwen3.8-27B-GGUF by lmstudio-community
lmstudio-community · Kit
A GGUF quantization of Qwen's Qwen3.8-27B made by the LM Studio team with llama.cpp, for people who run a 27B model on their own computer.
New
Raon-1 mini (GGUF)
KRAFTON · Kit
Runs a 28.8B mixture-of-experts model tuned for Korean chat, reasoning and tool-using agents in llama.cpp. GGUF copy of Raon-1 mini preview for people who run…
New
Sage-A1.5 GGUF (Q4_K_M)
InternScience · Kit
Runs Sage-A1.5, a 35B mixture-of-experts agentic model for long scientific tasks, as a 4-bit GGUF file. It can split work across subagents and check its own pr…
New
Qwen3.8-2B-Distill-GGUF
empero-ai · Kit
Runs a small 2B reasoning model on phones, laptops and single-board computers, as GGUF files in five quant levels. A distillation of a large Qwen3.8 model, pac…
New
Nanbeige_Nanbeige4.3-33B-GGUF
bartowski · Kit
GGUF quantizations of Nanbeige4.3-33B, made by bartowski with an importance matrix, from about 21 GB to 66 GB. For running a 33B English and Chinese text model…
New
TinyLlama-1.1B-Chat-v1.0
TinyLlama · Kit
Chats in plain text as a small 1.1B language model that runs with little memory. For developers and researchers who want a compact chat model built on a Llama-…
New
Llama-V-JEPA-LM-Qwen3-4B
kkt94 · Kit
Answers questions about video clips with a 5.1B model that joins a frozen V-JEPA 2.1 video encoder to Qwen3-4B-Instruct-2507, for people who need video underst…
New
Llama-V-JEPA-LM-Qwen3-1.7B
kkt94 · Kit
Answers questions about video clips with a 2B model that joins a frozen V-JEPA 2.1 video encoder to Qwen3-1.7B, for people who need video understanding on one…
New
Llama-V-JEPA-LM-Llama3.2-3B
kkt94 · Kit
Answers questions about video clips with a 4.2B model that joins a frozen V-JEPA 2.1 video encoder to Llama-3.2-3B-Instruct, for people who need video understa…
New
Llama-V-JEPA-LM-Llama3.2-1B
kkt94 · Kit
Answers questions about video clips with a small 1.5B model that joins a frozen V-JEPA 2.1 video encoder to Llama-3.2-1B-Instruct, for people who need video un…
New