Mellum2.1-12B-A2.5B-Thinking-GGUF
JetBrains · Kit
Runs JetBrains' 12B reasoning model locally in llama.cpp, Ollama or LM Studio, with five GGUF sizes to pick from. For developers who want a thinking model with…
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
JetBrains · Kit
Runs JetBrains' 12B reasoning model locally in llama.cpp, Ollama or LM Studio, with five GGUF sizes to pick from. For developers who want a thinking model with…
flechin · Kit
A 27B reasoning model tuned to answer plainly instead of hedging, quantized to MXFP4 so vLLM can serve it on a single 32 GB GPU, for developers who run local r…
Runs a pruned, 2-bit DeepSeek-V4.1-Flash on a 128 GB Mac through mlx-serve, keeping 192 of 384 experts and a 1M-token context. Strongest on code, reasoning and…
BlinkDL · Kit
Pure RNN text-generation base models for chat, reasoning and tool calls, meant as a starting point for post-training and fine-tuning. Covers eight languages, f…
XHToken · Kit
A 4.1B language model for on-device use, tuned for coding, agent tasks, long context and reasoning in English and Chinese, with three thinking levels. For deve…
SolsticeAI · Kit
Offers GGUF quantizations of the 33.1B Nanbeige4.3 model for llama.cpp and Ollama, with a reasoning protocol and up to 524,288 tokens of context. For developer…
Qwen · Kit
Answers chat prompts with a 4B model that skips visible thinking and reads up to 256K tokens of context. For developers who want a small open assistant for rea…
prithivMLmods · Kit
GGUF copies of a small Qwen3.5 0.8B model whose weights were edited directly to reduce reasoning loops. For people who want to run it locally in several quant…
PCL-RSI-lab · Kit
Fixes software bugs with a self-improving coding agent that learns reusable reasoning patterns from its own successful runs, for developers and researchers wor…
NousResearch · Kit
A 14B hybrid reasoning model from Nous Research, built on Qwen3-14B. It can think step by step, call tools, and return JSON that follows a schema. It uses the…
inclusionAI · Kit
Listens to audio plus a text instruction and returns text, or text with synthesized speech. Covers speech recognition, spoken questions and audio reasoning in…
google · Kit
Reads text and images and writes text, for developers who want an open-weights Google DeepMind model for coding, reasoning and image questions on their own GPU…
GGUF build of LiquidAI's LFM2.5-8B-A1B, a sparse mixture-of-experts model, with DavidAU's Turbo Brilliance system and 12 reasoning modes. An 8.5B beta-style re…
GGUF build of LiquidAI's LFM2.5-2.6B with DavidAU's Turbo Brilliance system, adding 12 reasoning and 12 instruct modes you switch in the prompt. A 2.7B beta fo…
unsloth · Kit
Runs OpenAI's open-weight gpt-oss-20b reasoning model on your own computer, packed as GGUF files by unsloth. Suits developers who want a local model with adjus…
prism-ml · Kit
Runs a 27B-class reasoning model as a 1-bit GGUF file of about 3.9 GB for llama.cpp, so it fits a laptop or one GPU. For people who want local reasoning on eve…
KRAFTON · Kit
Runs a 28.8B mixture-of-experts model tuned for Korean chat, reasoning and tool-using agents in llama.cpp. GGUF copy of Raon-1 mini preview for people who run…
JetBrains · Kit
A 12B mixture-of-experts thinking model with 2.5B active parameters, trained with reinforcement learning on real repositories for coding agents, math and hard…
IFM · Kit
Writes text, code and reasoning answers with a 512K-token context window, for developers and researchers who want an open dense model whose training data, code…
empero-ai · Kit
Runs a small 2B reasoning model on phones, laptops and single-board computers, as GGUF files in five quant levels. A distillation of a large Qwen3.8 model, pac…