GGUF fine-tune of a 27B Qwen model by DavidAU, with switchable instruct and reasoning modes and a built-in help system. Hugging Face lists it as image text to…
AI projects from Hugging Face
Categories and filters
Listings
Answers questions and reads images with much shorter thinking. GGUF builds of a 27B Qwen 3.8 tune from DavidAU that aims to cut reasoning tokens while keeping…
Maximizing Model Performance Guide
DavidAU · Kit
Guides you in tuning samplers and parameters for local language models, with steps for system prompts, reasoning models and expert settings in LM Studio, Silly…
Qwen3.8-27B-CodeForge-3xMerge
xtools-at · Kit
Writes and explains code and works through reasoning problems, from a weighted merge of three Qwen3.8-27B fine-tunes. For developers who want one general-purpo…
Qwen3-4B-GGUF
Qwen · Kit
A 4B chat model in GGUF format that runs locally in llama.cpp or ollama, with a thinking mode for reasoning and a plain mode for quick replies. Suits developer…
AREX-2 GGUF
mradermacher · Kit
GGUF quantized files of BAAI's AREX-2, a 26.9B model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit people who run a large model local…
Mellum2.1-12B-A2.5B-Thinking-GGUF
JetBrains · Kit
Runs JetBrains' 12B reasoning model locally in llama.cpp, Ollama or LM Studio, with five GGUF sizes to pick from. For developers who want a thinking model with…
Granite-4.2-30B
ibm-granite · Kit
Works through a problem in steps before it answers, for math, code, tool calling and multilingual chat. IBM's largest dense Granite 4.2 model, under Apache 2.0…
gnani-evon-v3.3-30B-A3B
gnani · Kit
Chats, answers questions and reasons in English and ten Indic languages with a 128K context. A 30B mixture-of-experts model from Gnani.ai, for teams building a…
Qwen3.8-27B-Randean-MXFP4
flechin · Kit
A 27B reasoning model tuned to answer plainly instead of hedging, quantized to MXFP4 so vLLM can serve it on a single 32 GB GPU, for developers who run local r…
Qwen3.8-27B-Ridge-GGUF
empero-ai · Kit
Runs Qwen3.8-27B as a compact 3.7 bits-per-weight GGUF file that suits a 16 GB GPU, with optional image input. For people running models locally with llama.cpp…
Runs a pruned, 2-bit DeepSeek-V4.1-Flash on a 128 GB Mac through mlx-serve, keeping 192 of 384 experts and a 1M-token context. Strongest on code, reasoning and…
RWKV7-G1 GooseOne
BlinkDL · Kit
Pure RNN text-generation base models for chat, reasoning and tool calls, meant as a starting point for post-training and fine-tuning. Covers eight languages, f…
Kolibri-1
Aleph-Alpha · Kit
Reasons and calls tools in German and English, with a context window of more than a million tokens. An open 78B mixture-of-experts model from Aleph Alpha that…
Spark-X2.6-4B-Base
XHToken · Kit
A 4.1B language model for on-device use, tuned for coding, agent tasks, long context and reasoning in English and Chinese, with three thinking levels. For deve…
Nanbeige4.3-33B-GGUF-UltraOptimised-Curated-Protium
SolsticeAI · Kit
Offers GGUF quantizations of the 33.1B Nanbeige4.3 model for llama.cpp and Ollama, with a reasoning protocol and up to 524,288 tokens of context. For developer…
Qwen3-4B-Instruct-2507
Qwen · Kit
Answers chat prompts with a 4B model that skips visible thinking and reads up to 256K tokens of context. For developers who want a small open assistant for rea…
Qwen3.5-0.8B-weight-space-programming-GGUF
prithivMLmods · Kit
GGUF copies of a small Qwen3.5 0.8B model whose weights were edited directly to reduce reasoning loops. For people who want to run it locally in several quant…
Seshat Agent
PCL-RSI-lab · Kit
Fixes software bugs with a self-improving coding agent that learns reusable reasoning patterns from its own successful runs, for developers and researchers wor…
Hermes 4 14B
NousResearch · Kit
A 14B hybrid reasoning model from Nous Research, built on Qwen3-14B. It can think step by step, call tools, and return JSON that follows a schema. It uses the…