officialmobai_Rostam-S1-4B-GGUF
bartowski · Kit
GGUF quantizations of Rostam-S1-4B, a 4B reasoning model for math, physics, software work and Persian-English text. For people who run small models locally and…
New
AI projects from Hugging Face
Categories and filters
Listings
Hemmingway-1.5 GGUF
bartowski · Kit
Imatrix GGUF quantizations of HemmingwayAI's Hemmingway-1.5, a 27B text model with MTP speculative decoding and a reasoning-effort prompt format. For people wh…
New
Swift 1.5 Ornith 9B GGUF
ukisai · Kit
Runs Swift 1.5 Ornith 9B, a reasoning model tuned to think with fewer tokens, as GGUF quantizations for llama.cpp. For people who run a 9B reasoning model on t…
New
Phi-4-mini-instruct
microsoft · Kit
A 3.8B open instruction model from Microsoft with a 128K token context, built for reasoning, math and logic in tight memory or latency budgets. It suits develo…
New
Qwen3.8-9B-Distill
empero-ai · Kit
Reasons step by step through math, code and general questions, opening each answer with a thinking block. A 9B Qwen3.5 model trained on traces from a larger Qw…
New
Groot-19B-A3B-TTQ-GGUF
TokenTinkerer · Kit
Offers eleven GGUF sizes of the Groot-19B-A3B reasoning model for llama.cpp, from 7.88 to 18.59 GiB, plus a vision projector. Made for people who run the model…
New
Qwen3-30B-A3B-GGUF by unsloth
unsloth · Kit
GGUF files of Qwen3-30B-A3B, quantized by unsloth, for running a local chat and reasoning model in llama.cpp, Ollama or Open WebUI, with a thinking mode you ca…
New
Olmo-3-32B-Think-GGUF
unsloth · Kit
Gives you Olmo 3 32B Think, a 32.2B-parameter reasoning model, as GGUF files that run on your own computer. Packaged by unsloth for people who want a local mod…
New
gpt-oss-120b-GGUF
unsloth · Kit
Runs OpenAI's open-weight gpt-oss-120b, a 117B model with 5.1B active parameters, from GGUF files by Unsloth that carry its fixes. Built for reasoning, agent t…
New
Qwen3.8-27b-Terse-Coder-LoRA
Shockem · Kit
Cuts the length of Qwen3.8-27B's reasoning on coding tasks so answers arrive sooner, as a small LoRA adapter. For people who run the base model on their own ha…
New
Qwen3.5-122B-A10B
Qwen · Kit
Reads images and text together and answers in text, as a mixture-of-experts model with 122B total and 10B active parameters. Suits teams with big GPU servers w…
New
Qwen3-8B-MLX-bf16
Qwen · Kit
Runs the Qwen3 8B language model through the mlx library for chat, reasoning, translation and agent work. Suits developers who want a local text model with a s…
New
Limite 1B - Violetto
paradigma-inc · Kit
Solves hard math problems with a 1B-parameter model trained from scratch for fast, high-volume reasoning. It suits developers who run math workloads on an NVID…
New
Raptor-0.6-4B-JANG_6M
OsaurusAI · Kit
Decides when to call a tool, when to answer directly and when to ask first, tuned from a 4B model and quantized for Apple Silicon Macs running Osaurus. For peo…
New
NuExtract3
numind · Kit
Reads documents as text or images and fills a JSON template with the fields you ask for, or converts the pages to Markdown. A 4B model for teams that process s…
New
Hermes-4.3-36B-GGUF
NousResearch · Kit
A 36B hybrid reasoning model in GGUF form that can think before it answers, write valid JSON and follow your system prompt. For people who run a large model on…
New
Qwen3.8-27B Fable-5 Coding Distilled GGUF
mradermacher · Kit
GGUF quantized files of a 27.3B coding-distilled Qwen3.8 model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit developers who run a cod…
New
VulnLLM-R-7B-8bit
mlx-community · Kit
Runs an 8-bit MLX copy of VulnLLM-R-7B for text generation through mlx-lm. Meant for developers who want to try the model locally. The card does not say what i…
New
Phi-4
microsoft · Kit
A 14B open language model from Microsoft Research, tuned for reasoning and chat in English with limited compute. It suits developers who add text features to a…
New
Qwen3.6-35B-A3B Claude 4.7 Opus Reasoning Distilled
lordx64 · Kit
Thinks in explicit think blocks before it answers, tuned on about 8k reasoning traces from Claude Opus 4.7. A 35B mixture-of-experts Qwen3.6 variant for hard m…
New
Qwopus3.8-27B-Flash-GGUF
Jackrong · Kit
Cuts reasoning time and cost for long agent tasks, as a GGUF build of a Qwen3.8-27B fine-tune. Made for people who run agent loops on their own machine and wan…
New
Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled-GGUF
Jackrong · Kit
Thinks through problems step by step inside think tags, as a 4B Qwen3.5 model fine-tuned on reasoning chains and packaged as GGUF. For people who run a small r…
New
Runs a tiny 0.8B reasoning-tuned chat model in the MLX format at 6-bit, converted from Jackrong's Qwen3.5 distilled model. For people who want a tiny local mod…
New
Qwen3.8-27B-NVFP4 Deployment Edition
IteraCompute · Kit
Serves Qwen3.8-27B in NVFP4 on one RTX 5090 with vLLM, with a checksum-verified download, FP8 KV cache, tool calls and reasoning support. For developers self-h…
New
Qwen3.6-35B-A3B-2Bit-GSQ
ISTA-DASLab · Kit
A 2-bit quantized copy of Qwen3.6-35B-A3B made with GSQ, a Gumbel-Softmax method, that keeps most reasoning and coding ability at a much smaller memory footpri…
New
Agents-A1
InternScience · Kit
Runs multi-step agent work: planning, search, tool calling and scientific reasoning, as a 35B open-weight language model. Built for developers who wire a model…
New
K2-Horizon-0.9B
IFM · Kit
Answers maths, coding and science questions as a compact open reasoning model that reads up to 128K tokens at once. Built by IFM for people who want a small mo…
New
Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF
hesamation · Kit
Runs a reasoning-tuned Qwen3.6-35B-A3B on your own machine as GGUF files in four quant sizes, trained on Claude Opus 4.6 style reasoning data. For people who w…
New
KVARK Sparkle 1.0 (27B) FP8
Egzakta · Kit
Runs a 27B model that reads images and text, in FP8 for vLLM. It reasons with far fewer tokens than a Qwen model of the same size. Made for people who host the…
New
Kvark-Sparkle-1.0-27B
Egzakta · Kit
Reasons over images and text with fewer thinking tokens than its base Qwen3.8-27B, so answers arrive in about half the time at similar accuracy, per its card.…
New
Maple-Preview
deepgrove · Kit
A 20B ternary-weight reasoning model that activates about 1B parameters per token. Built for fast on-device use, with a 5.31 GB checkpoint and 131,072 token co…
New
Chroma Context-1
chromadb · Kit
A 20B-parameter search model that finds supporting documents for complex, multi-step questions and trims its own working context as it goes. Meant to act as a…
New
granite-4.2-3b-GGUF
bartowski · Kit
Quantized GGUF copies of IBM's granite-4.2-3b text model, in many sizes from full precision down to small 3-bit files. For people who run a small chat model on…
New
Qwen3.8-Whittle-MoE-27B-MLX-4bit
barozp · Kit
A 4-bit MLX build for Apple Silicon of a mixture-of-experts model carved from the dense Qwen3.8-27B, with 17.8B active of 27B total parameters. For people who…
New
ERNIE-4.5-21B-A3B-Thinking
baidu · Kit
Reasoning-focused ERNIE 4.5 mixture-of-experts text model with 21B total and 3B active parameters, 128K context and tool calling, in English and Chinese. For d…
New
Apodex-1.1-mini-GGUF
apodex · Kit
Reasoning model for long research tasks that works with files, data, code and tools, packaged as GGUF files you can host yourself. Suits researchers and develo…
New
K2-Horizon-3.7B
IFM · Kit
Handles coding, reasoning and agent-style tasks as a small open model with a 512K token context window. Built by IFM for people who want public training data,…
New
GigaChat3.5-432B-A28B
ai-sage · Kit
Generates text in Russian and English for chat, code, reasoning and tool use. A 432B Mixture-of-Experts model with 28B active parameters, aimed at teams that h…
New
NeoHorse-1-9B
TokenRhythm · Kit
A 9B text model post-trained from Qwen3.5-9B for agent frameworks, tool use, coding and instruction following, released as text-only weights. For developers wh…
New
GLM-5.3-SuperExpert-v2-9.2GB
shashanth-27xA9 · Kit
A text generation model compressed from GLM-5.3-Flash to 9.2 GB that its author says runs on a 16 GB laptop or a free Colab T4. Non-commercial license.
New
Beam-1.0-501B-A23B-NVFP4
reflection · Kit
Reads and writes text with a 1M-token context, built for coding, agent tool use and math reasoning, as a 501B-parameter mixture-of-experts model in NVFP4 form.…
New
Qwen3-1.7B
Qwen · Kit
A compact 1.7B chat model that switches between a thinking mode for reasoning and a quick mode for dialogue. Suits developers who want a small open model for c…
New
1-bit Bonsai 27B (MLX)
prism-ml · Kit
Runs a 27B-class reasoning model packed to 1 bit per weight, about 3.9 GB, on Apple MLX, with 262K-token context. For developers who want a large model on a ph…
New
gpt-oss-safeguard-20b
openai · Kit
Classifies text against a safety policy you write and shows its reasoning. For trust and safety teams filtering model inputs and outputs, labeling content onli…
New
gpt-oss-safeguard-120b
openai · Kit
Sorts text against a safety policy that you write, and shows its reasoning for each decision. It suits trust and safety teams that filter or label content.
New
Rostam-S1-4B
officialmobai · Kit
Reasons step by step through math, physics, scientific code and Persian or English questions, with tool calling. A 4.1B model built on Spark-X2.6-4B, for peopl…
New
NV-Reason-CT
nvidia · Kit
Reads chest and abdominal CT volumes to write structured radiology reports, answer questions and explain its reasoning. For researchers and developers working…
New
Qwen3.8-27B-CodeForge-3xMerge i1 GGUF
mradermacher · Kit
Importance-matrix GGUF quants of the Qwen3.8-27B-CodeForge-3xMerge model, from about 11 GB to 22.5 GB, for local use. For people running 27B models on their ow…
New
Tess-4.5-27B GGUF
migtissera · Kit
GGUF builds of Tess-4.5, a 27B open-weights coding and agent model, for llama.cpp, with a vision projector and optional draft heads for faster generation. They…
New
Qwen3.8-27B-Fable-5-Coding-Distilled
khazarai · Kit
Debugs and reviews code by checking real files before it proposes a fix, a Qwen3.8-27B fine-tune trained on 195M tokens of reasoning traces. For developers who…
New
Qwen3.8-27B Astra stop edit
jarrodwatts · Kit
A small weight edit for Qwen3.8-27B, with a script that applies it, that cuts the model's thinking length on open-ended tasks by changing a single matrix, with…
New
Qwopus3.8-27B-Flash-V2-GGUF
Jackrong · Kit
Trims wasted reasoning in long agent tasks, as a GGUF build of the second Flash fine-tune of Qwen3.8-27B with better Python formatting. For people who run agen…
New
Qwopus3.8-27B-Coder-Flash
Jackrong · Kit
Writes code, calls tools and works through software tasks as a coding agent. A 27.8B fine-tune of Qwen3.8-27B by Jackrong, trained on about 200,000 code and re…
New
Ling-3.0-tiny-GGUF
inclusionAI · Kit
GGUF copy of inclusionAI's Ling-3.0-tiny, a small mixture-of-experts reasoning model with 7.9B total and 1.3B active parameters, for running locally at low cos…
New
granite-4.2-3b
ibm-granite · Kit
Reasons step by step before it answers, with tool calling, code generation and multilingual chat, in a compact 3B model from IBM. Supports a 128K context nativ…
New
KVARK Sparkle 1.1 27B GGUF
Egzakta · Kit
Runs the 27B KVARK Sparkle 1.1 model from GGUF files in several sizes, with optional image input and speculative decoding. For people running models locally wi…
New
KVARK Sparkle 1.1 (27B)
Egzakta · Kit
A 27B model tuned for document work: it searches a document base, answers from what it finds and says so when the answer is missing, for builders of document a…
New
Kvark-Sparkle-1.0-27B-GGUF
Egzakta · Kit
GGUF files of KVARK Sparkle 1.0, a 27B vision-language model, for llama.cpp, Ollama and LM Studio, with the speculative-decoding head kept. For people running…
New
DeepSeek-V3.2
deepseek-ai · Kit
A 685B open reasoning model from DeepSeek with sparse attention for long context and a chat template that lets it think while it calls tools. For teams that ru…
New
Qwen3.8 Flash Next Turbo Brilliance 50x GGUF
DavidAU · Kit
A GGUF build of Qwen3.8-Flash-Next by DavidAU with 27 reasoning modes, 27 instruct modes and 15 AI personas you switch on from the prompt. For people with larg…
New
GGUF fine-tune of a 27B Qwen model by DavidAU, with switchable instruct and reasoning modes and a built-in help system. Hugging Face lists it as image text to…
New
Answers questions and reads images with much shorter thinking. GGUF builds of a 27B Qwen 3.8 tune from DavidAU that aims to cut reasoning tokens while keeping…
New
Maximizing Model Performance Guide
DavidAU · Kit
Guides you in tuning samplers and parameters for local language models, with steps for system prompts, reasoning models and expert settings in LM Studio, Silly…
New
Qwen3.8-27B-CodeForge-3xMerge
xtools-at · Kit
Writes and explains code and works through reasoning problems, from a weighted merge of three Qwen3.8-27B fine-tunes. For developers who want one general-purpo…
New
Qwen3-4B-GGUF
Qwen · Kit
A 4B chat model in GGUF format that runs locally in llama.cpp or ollama, with a thinking mode for reasoning and a plain mode for quick replies. Suits developer…
New
AREX-2 GGUF
mradermacher · Kit
GGUF quantized files of BAAI's AREX-2, a 26.9B model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit people who run a large model local…
New
Mellum2.1-12B-A2.5B-Thinking-GGUF
JetBrains · Kit
Runs JetBrains' 12B reasoning model locally in llama.cpp, Ollama or LM Studio, with five GGUF sizes to pick from. For developers who want a thinking model with…
New
Granite-4.2-30B
ibm-granite · Kit
Works through a problem in steps before it answers, for math, code, tool calling and multilingual chat. IBM's largest dense Granite 4.2 model, under Apache 2.0…
New
gnani-evon-v3.3-30B-A3B
gnani · Kit
Chats, answers questions and reasons in English and ten Indic languages with a 128K context. A 30B mixture-of-experts model from Gnani.ai, for teams building a…
New
Qwen3.8-27B-Randean-MXFP4
flechin · Kit
A 27B reasoning model tuned to answer plainly instead of hedging, quantized to MXFP4 so vLLM can serve it on a single 32 GB GPU, for developers who run local r…
New
Qwen3.8-27B-Ridge-GGUF
empero-ai · Kit
Runs Qwen3.8-27B as a compact 3.7 bits-per-weight GGUF file that suits a 16 GB GPU, with optional image input. For people running models locally with llama.cpp…
New
Runs a pruned, 2-bit DeepSeek-V4.1-Flash on a 128 GB Mac through mlx-serve, keeping 192 of 384 experts and a 1M-token context. Strongest on code, reasoning and…
New
RWKV7-G1 GooseOne
BlinkDL · Kit
Pure RNN text-generation base models for chat, reasoning and tool calls, meant as a starting point for post-training and fine-tuning. Covers eight languages, f…
New
Kolibri-1
Aleph-Alpha · Kit
Reasons and calls tools in German and English, with a context window of more than a million tokens. An open 78B mixture-of-experts model from Aleph Alpha that…
New
Spark-X2.6-4B-Base
XHToken · Kit
A 4.1B language model for on-device use, tuned for coding, agent tasks, long context and reasoning in English and Chinese, with three thinking levels. For deve…
New
Nanbeige4.3-33B-GGUF-UltraOptimised-Curated-Protium
SolsticeAI · Kit
Offers GGUF quantizations of the 33.1B Nanbeige4.3 model for llama.cpp and Ollama, with a reasoning protocol and up to 524,288 tokens of context. For developer…
New
Qwen3-4B-Instruct-2507
Qwen · Kit
Answers chat prompts with a 4B model that skips visible thinking and reads up to 256K tokens of context. For developers who want a small open assistant for rea…
New
Qwen3.5-0.8B-weight-space-programming-GGUF
prithivMLmods · Kit
GGUF copies of a small Qwen3.5 0.8B model whose weights were edited directly to reduce reasoning loops. For people who want to run it locally in several quant…
New
Seshat Agent
PCL-RSI-lab · Kit
Fixes software bugs with a self-improving coding agent that learns reusable reasoning patterns from its own successful runs, for developers and researchers wor…
New
Hermes 4 14B
NousResearch · Kit
A 14B hybrid reasoning model from Nous Research, built on Qwen3-14B. It can think step by step, call tools, and return JSON that follows a schema. It uses the…
New
Qwen3.5-9B Brainwaves DeepThought STEM OneJev1.6
nightmedia · Kit
An experimental 9.4B image-and-text model made by nightmedia, a merge of three 9B models aimed at reasoning and science questions. It suits hobbyists and resea…
New
AREX-2-i1-GGUF
mradermacher · Kit
Weighted GGUF quantizations of BAAI/AREX-2, a 26.9B vision model, in about two dozen sizes from 7.2 GB to 22.2 GB, plus an imatrix file for making your own qua…
New
Ming-3.0-audio-flash
inclusionAI · Kit
Listens to audio plus a text instruction and returns text, or text with synthesized speech. Covers speech recognition, spoken questions and audio reasoning in…
New
gemma-4-26B-A4B
google · Kit
Reads text and images and writes text, for developers who want an open-weights Google DeepMind model for coding, reasoning and image questions on their own GPU…
New
GGUF build of LiquidAI's LFM2.5-8B-A1B, a sparse mixture-of-experts model, with DavidAU's Turbo Brilliance system and 12 reasoning modes. An 8.5B beta-style re…
New
GGUF build of LiquidAI's LFM2.5-2.6B with DavidAU's Turbo Brilliance system, adding 12 reasoning and 12 instruct modes you switch in the prompt. A 2.7B beta fo…
New
gpt-oss-20b-GGUF
unsloth · Kit
Runs OpenAI's open-weight gpt-oss-20b reasoning model on your own computer, packed as GGUF files by unsloth. Suits developers who want a local model with adjus…
New
mai_replier-9b-v3
tcmofashi · Kit
Plays a persona in Chinese QQ group chats by reading the chat history and writing one short, casual reply with no visible reasoning. A merged 9B fine-tune of Q…
New
Bonsai-27B-gguf
prism-ml · Kit
Runs a 27B-class reasoning model as a 1-bit GGUF file of about 3.9 GB for llama.cpp, so it fits a laptop or one GPU. For people who want local reasoning on eve…
New
Raon-1 mini (GGUF)
KRAFTON · Kit
Runs a 28.8B mixture-of-experts model tuned for Korean chat, reasoning and tool-using agents in llama.cpp. GGUF copy of Raon-1 mini preview for people who run…
New
Mellum2.1-12B-A2.5B-Thinking
JetBrains · Kit
A 12B mixture-of-experts thinking model with 2.5B active parameters, trained with reinforcement learning on real repositories for coding agents, math and hard…
New
K2-Horizon-7B
IFM · Kit
Writes text, code and reasoning answers with a 512K-token context window, for developers and researchers who want an open dense model whose training data, code…
New
Granite-4.2-8B
ibm-granite · Kit
Reasons step by step, writes code, calls tools and chats in several languages with a context of up to 128K tokens, extendable to 512K. IBM's dense 8B model, fo…
New
Quark
FirstPrinciplesLabs · Kit
A 9B reasoning model for physics, science and maths, fine-tuned from Qwen3.5-9B by FirstPrinciples. For researchers who want step-by-step derivations and a sec…
New
Qwen3.8-2B-Distill-GGUF
empero-ai · Kit
Runs a small 2B reasoning model on phones, laptops and single-board computers, as GGUF files in five quant levels. A distillation of a large Qwen3.8 model, pac…
New
CherryPit-1.2-2B
DRUPEs · Kit
A 2B coding and chat model built on MiniCPM5-2B that is much better at web apps needing several features in one component. For developers who want a small loca…
New
Qwen3.8-27B-pi
bytkim · Kit
A 27B coding model tuned for the Pi agent framework, trained to read a repository, edit files, run tools and use their feedback, with adjustable reasoning effo…
New
GLM-5.3-Flash-NVFP4
nvidia · Kit
Gives you NVIDIA's NVFP4 quantized copy of ZAI's GLM-5.3-Flash, a multimodal model for reasoning, coding and agent tasks. Meant for developers who deploy on Bl…
New
Hermes-4.3-36B
NousResearch · Kit
Runs as a reasoning chat model that can think step by step or answer fast, and returns JSON that fits a schema you give it. Made for people who host their own…
New
gemma-4-31B
google · Kit
Reads text and images and writes text, for developers and researchers who want Google DeepMind's largest dense open-weights Gemma 4 model for coding, reasoning…
New