Hermes-4.3-36B-GGUF
NousResearch · Kit
A 36B hybrid reasoning model in GGUF form that can think before it answers, write valid JSON and follow your system prompt. For people who run a large model on…
New
AI projects from Hugging Face
Categories and filters
Listings
Qwen3.8-Flash-Next-DFlash2-GGUF
nazeshinjite · Kit
GGUF draft model that speeds up Qwen3.8-Flash-Next in llama.cpp through speculative decoding, in 334 MiB and 622 MiB files. It is not a standalone model, and i…
New
Nanbeige4.3-33B-INT4
Nanbeige · Kit
INT4 quantized version of Nanbeige4.3-33B, a 33B model for coding and professional agent tasks, made with quantization-aware training. For developers who want…
New
Nanbeige4.2-3B by Nanbeige
Nanbeige · Kit
Compact looped-transformer model of 4.2B parameters for agent work such as tool use, office tasks and coding, in English and Chinese. For developers who want a…
New
Agaram 2.5B
murai-labs · Kit
Chats in Tamil script, romanized Tamil and English, and translates between Tamil and English. A 2.5B model built from scratch by Murai Labs, for Tamil speakers…
New
VulnLLM-R-7B-8bit
mlx-community · Kit
Runs an 8-bit MLX copy of VulnLLM-R-7B for text generation through mlx-lm. Meant for developers who want to try the model locally. The card does not say what i…
New
JevK5-chat-mlx-4bit
mlx-community · Kit
A 4-bit MLX copy of the 4.2B JevK5 chat model for Apple Silicon, with a 262,144 token context and a small memory footprint. Made for Mac users who want a quick…
New
flint-mixed-3-4bit
mlx-community · Kit
A community MLX build of Recursive's 40B Flint coding model that shrinks the experts to 3 bits, so it fits a 24 GB or 32 GB Apple Silicon Mac. Made for develop…
New
Mistral-7B-v0.1
mistralai · Kit
Generates and continues text as a 7B pretrained base model, for researchers and developers who want a starting point to test, tune or build on.
New
Mistral-7B-Instruct-v0.1
mistralai · Kit
A 7B instruction-tuned chat model from Mistral, fine-tuned from Mistral-7B-v0.1 on public conversation datasets. Made for developers who want a small open mode…
New
MiroThinker-v1.0-8B
miromind-ai · Kit
An open research agent model that reasons over long contexts and calls tools many times per task to look up information. The 8B size, built on Qwen3-8B, suits…
New
KLM 1.5
MinimaLabs · Kit
A 99M-parameter base language model trained from scratch on 100B tokens, with a hybrid attention design. Made for researchers and tinkerers who want a tiny ope…
New
Phi-4-multimodal-instruct
microsoft · Kit
Compact 5.6B model that takes text, images and audio and replies in text, with a 128K token context. For developers who want speech, vision and text in one sma…
New
Phi-4
microsoft · Kit
A 14B open language model from Microsoft Research, tuned for reasoning and chat in English with limited compute. It suits developers who add text features to a…
New
Maya-1
maya-research · Kit
An open-weight text-to-speech model where you describe the voice in plain words and add inline emotion cues. It suits developers and creators who need expressi…
New
dale-9b (GGUF)
manuelgscom · Kit
Turns a Spanish or English request into one Linux bash command, returned as a small JSON object. For terminal users and developers who want a local command hel…
New
askmdb-9b-GGUF
manuelgscom · Kit
Writes a read-only MongoDB aggregate pipeline from a plain Spanish or English question. A GGUF copy of a Qwen3.5-9B fine-tune that runs locally with llama.cpp,…
New
Maincoder-1B
Maincode · Kit
Completes and writes Python code from a function signature or a docstring. A 1B code model from Maincode that is small enough to run on consumer hardware, for…
New
Qwen3.6-35B-A3B Claude 4.7 Opus Reasoning Distilled
lordx64 · Kit
Thinks in explicit think blocks before it answers, tuned on about 8k reasoning traces from Claude Opus 4.7. A 35B mixture-of-experts Qwen3.6 variant for hard m…
New
ColGrep-Agent-2B
lightonai · Kit
A 2.5B-parameter model that finds the files and line ranges relevant to a bug report or question about a code repository, by searching and reading the repo. Ru…
New
humanizer-GGUF
jialinyyzz · Kit
Rewrites AI-written drafts in English and Chinese so they read like a person wrote them, keeping numbers, dates, names and quotes. A 12B model in GGUF files fo…
New
Qwopus3.8-27B-Flash-GGUF
Jackrong · Kit
Cuts reasoning time and cost for long agent tasks, as a GGUF build of a Qwen3.8-27B fine-tune. Made for people who run agent loops on their own machine and wan…
New
Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled-GGUF
Jackrong · Kit
Thinks through problems step by step inside think tags, as a 4B Qwen3.5 model fine-tuned on reasoning chains and packaged as GGUF. For people who run a small r…
New
Runs a tiny 0.8B reasoning-tuned chat model in the MLX format at 6-bit, converted from Jackrong's Qwen3.5 distilled model. For people who want a tiny local mod…
New
Agents-A1
InternScience · Kit
Runs multi-step agent work: planning, search, tool calling and scientific reasoning, as a 35B open-weight language model. Built for developers who wire a model…
New
Flint-DFlash2
incoai · Kit
A 403M-parameter draft model that speeds up serving of the Flint language model with speculative decoding in SGLang, without changing its output. It is not a s…
New
K2-Horizon-3.7B-GGUF
IFM · Kit
GGUF files of the 3.7B K2-Horizon text model in six precision levels, from BF16 to Q4_K_M, for running with llama.cpp. The model has a 512K-token context windo…
New
K2-Horizon-0.9B
IFM · Kit
Answers maths, coding and science questions as a compact open reasoning model that reads up to 128K tokens at once. Built by IFM for people who want a small mo…
New
ibnsina-1.5b
ibnsina-llm · Kit
A small Persian language model for writing, summarizing, translating and chatting offline, trained from scratch mostly on Persian text. Runs through ollama, LM…
New
Granite-Docling-258M
ibm-granite · Kit
Converts document page images into structured text, with equations, layout and questions about page elements, in a 258M model from IBM Research. For people who…
New
Granite-4.0-H-350M
ibm-granite · Kit
Handles summaries, classification, extraction, question answering, RAG, code tasks and tool calling in 12 languages with a 340M-parameter instruct model from I…
New
ALLaM-7B-Instruct-preview
humain-ai · Kit
Answers questions and follows instructions in Arabic and English. A 7B model trained from scratch by the National Center for Artificial Intelligence at SDAIA,…
New
zephyr-7b-beta
HuggingFaceH4 · Kit
Chats as a helpful assistant, built by tuning Mistral-7B with direct preference optimization. For developers and hobbyists who want a small open chat model the…
New
Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF
hesamation · Kit
Runs a reasoning-tuned Qwen3.6-35B-A3B on your own machine as GGUF files in four quant sizes, trained on Claude Opus 4.6 style reasoning data. For people who w…
New
Parallel Constrained Decoding for Apple Silicon
harshatheg · Kit
Extracts structured fields, routes decisions and classifies text on Apple Silicon with MLX, scoring every schema field at once. Cuts latency 5.6x to 7.0x on an…
New
Tev-320B
gordonhu · Kit
A 320B mixture-of-experts agent model that works through long terminal tasks with a single bash tool. Trained with reinforcement learning on 1,170 environments…
New
Qwen2.5-Coder-1.5B Q8_0 GGUF
ggml-org · Kit
Runs Qwen2.5-Coder 1.5B on your own machine as a Q8_0 GGUF file through llama.cpp, from the command line or as a local server. It suits developers who want a s…
New
SaulLM-54B-Instruct
Equall · Kit
A language model tuned for legal text, trained on US and European legal sources. A research release for people who study or adapt legal AI. Its answers are inf…
New
ARK-ASR-3B
Edge0 · Kit
Turns speech into text in many languages, with a Whisper-style audio encoder feeding a Qwen decoder. For developers and researchers who want multilingual trans…
New
theOG-50M
DrunkkToys · Kit
Writes a Python function from a plain English request. A 50M parameter code model trained from scratch on one laptop, small enough to run offline in Ollama, LM…
New
Maple-Preview
deepgrove · Kit
A 20B ternary-weight reasoning model that activates about 1B parameters per token. Built for fast on-device use, with a 5.31 GB checkpoint and 131,072 token co…
New
Kiyo-65M
DedeProGames · Kit
Continues English text with a tiny 65M-parameter decoder-only model trained on 80B tokens. For learners and researchers who want a small transformers model to…
New
Gemma-3-12b-it-MAX-HORROR-Imatrix-GGUF
DavidAU · Kit
Writes fiction with a tint of horror. GGUF builds of Gemma 3 12B instruct, quantized with an imatrix made from a horror model, for creative writers who run mod…
New
PLLuM-12B-chat-2512
CYFRAGOVPL · Kit
A Polish-language chat model from the PLLuM family, tuned to human preferences for dialogue, question answering and summarization, with an eye on Polish public…
New
Qwen 3.6 35B-A3B REAP-48 v2 GGUF
crucible-labs · Kit
Runs a pruned and quantized Qwen3.6-35B-A3B in an 8.78 GiB GGUF file for llama.cpp, closer to the unquantized weights than the first release. For people with l…
New
Underdog-Woof-4B-1.1
ConwayResearch · Kit
Generates text as a compact 4.2B model, post-trained from Qwen 3 4B to work better with Underdog's own setup and quantized to 4-bit for MLX. For people running…
New
Instinct
continuedev · Kit
Predicts the next edit you are likely to make in your code. A 7.6B model from Continue, fine-tuned from Qwen2.5-Coder-7B, for developers who want to run it on…
New
ConeML 1.2B Experimental
ConeML · Kit
Names the tallest, oldest or first item among facts you supply, as a small English research model in FP32 Safetensors and Q8_0 GGUF files. For researchers, non…
New
North Mini Code
CohereLabs · Kit
An open-weights research model from Cohere for writing code, agentic software engineering and terminal tasks. A 30B model with 3B active, 256K context. For dev…
New
Chroma Context-1
chromadb · Kit
A 20B-parameter search model that finds supporting documents for complex, multi-step questions and trims its own working context as it goes. Meant to act as a…
New