Qwopus3.8-27B-Flash-GGUF
Jackrong · Kit
Cuts reasoning time and cost for long agent tasks, as a GGUF build of a Qwen3.8-27B fine-tune. Made for people who run agent loops on their own machine and wan…
New
AI projects from Hugging Face
Categories and filters
Listings
Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled-GGUF
Jackrong · Kit
Thinks through problems step by step inside think tags, as a 4B Qwen3.5 model fine-tuned on reasoning chains and packaged as GGUF. For people who run a small r…
New
Runs a tiny 0.8B reasoning-tuned chat model in the MLX format at 6-bit, converted from Jackrong's Qwen3.5 distilled model. For people who want a tiny local mod…
New
Qwen3.8-27B-NVFP4 Deployment Edition
IteraCompute · Kit
Serves Qwen3.8-27B in NVFP4 on one RTX 5090 with vLLM, with a checksum-verified download, FP8 KV cache, tool calls and reasoning support. For developers self-h…
New
Qwen3.6-35B-A3B-2Bit-GSQ
ISTA-DASLab · Kit
A 2-bit quantized copy of Qwen3.6-35B-A3B made with GSQ, a Gumbel-Softmax method, that keeps most reasoning and coding ability at a much smaller memory footpri…
New
Agents-A1
InternScience · Kit
Runs multi-step agent work: planning, search, tool calling and scientific reasoning, as a 35B open-weight language model. Built for developers who wire a model…
New
K2-Horizon-3.7B-GGUF
IFM · Kit
GGUF files of the 3.7B K2-Horizon text model in six precision levels, from BF16 to Q4_K_M, for running with llama.cpp. The model has a 512K-token context windo…
New
K2-Horizon-0.9B
IFM · Kit
Answers maths, coding and science questions as a compact open reasoning model that reads up to 128K tokens at once. Built by IFM for people who want a small mo…
New
ibnsina-1.5b
ibnsina-llm · Kit
A small Persian language model for writing, summarizing, translating and chatting offline, trained from scratch mostly on Persian text. Runs through ollama, LM…
New
granite-4.2-8b GGUF
ibm-granite · Kit
Holds GGUF copies of IBM's Granite 4.2 8B model in several quantization levels, ready for llama.cpp. For people who want to run the model locally and read its…
New
Granite-4.2-3B (GGUF)
ibm-granite · Kit
Packages IBM's Granite 4.2 3B text model as GGUF files for local use. The 4-bit weights are estimated at about 1.8 GB, for people who want a compact model unde…
New
Granite-4.0-H-350M
ibm-granite · Kit
Handles summaries, classification, extraction, question answering, RAG, code tasks and tool calling in 12 languages with a 340M-parameter instruct model from I…
New
ALLaM-7B-Instruct-preview
humain-ai · Kit
Answers questions and follows instructions in Arabic and English. A 7B model trained from scratch by the National Center for Artificial Intelligence at SDAIA,…
New
SmolVLM2-2.2B-Instruct
HuggingFaceTB · Kit
Answers questions about videos, images and text together, with a 2.2B model that needs about 5.2 GB of GPU memory for video. For developers building visual ass…
New
zephyr-7b-beta
HuggingFaceH4 · Kit
Chats as a helpful assistant, built by tuning Mistral-7B with direct preference optimization. For developers and hobbyists who want a small open chat model the…
New
Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF
hesamation · Kit
Runs a reasoning-tuned Qwen3.6-35B-A3B on your own machine as GGUF files in four quant sizes, trained on Claude Opus 4.6 style reasoning data. For people who w…
New
H2O-Lightning-4B
h2oai · Kit
Answers typed decision questions about a document, ticket, policy or conversation, and about its images, giving each option a probability. For teams that want…
New
Tev-320B
gordonhu · Kit
A 320B mixture-of-experts agent model that works through long terminal tasks with a single bash tool. Trained with reinforcement learning on 1,170 environments…
New
gemma-4-31B-it-qat-q4_0-gguf
google · Kit
Runs Google's Gemma 4 31B instruction-tuned model as a 4-bit GGUF file that reads text and images and answers in text. It suits developers and enthusiasts with…
New
Qwen2.5-Coder-1.5B Q8_0 GGUF
ggml-org · Kit
Runs Qwen2.5-Coder 1.5B on your own machine as a Q8_0 GGUF file through llama.cpp, from the command line or as a local server. It suits developers who want a s…
New
Clef-GGUF
ggml-org · Kit
GGUF files of Cloudflare's Clef decision model, which takes image and text input. Served with llama.cpp tools and called through a decision API path. For devel…
New
KVARK Sparkle 1.0 (27B) FP8
Egzakta · Kit
Runs a 27B model that reads images and text, in FP8 for vLLM. It reasons with far fewer tokens than a Qwen model of the same size. Made for people who host the…
New
Kvark-Sparkle-1.0-27B
Egzakta · Kit
Reasons over images and text with fewer thinking tokens than its base Qwen3.8-27B, so answers arrive in about half the time at similar accuracy, per its card.…
New
Rukopys-OCR-4B
ebinan92 · Kit
Reads Ukrainian handwritten documents from images, finds each text region, labels its type and returns the transcriptions as structured JSON. An open 4B vision…
New
theOG-50M
DrunkkToys · Kit
Writes a Python function from a plain English request. A 50M parameter code model trained from scratch on one laptop, small enough to run offline in Ollama, LM…
New
Maple-Preview
deepgrove · Kit
A 20B ternary-weight reasoning model that activates about 1B parameters per token. Built for fast on-device use, with a 5.31 GB checkpoint and 131,072 token co…
New
Kiyo-65M
DedeProGames · Kit
Continues English text with a tiny 65M-parameter decoder-only model trained on 80B tokens. For learners and researchers who want a small transformers model to…
New
Gemma-3-12b-it-MAX-HORROR-Imatrix-GGUF
DavidAU · Kit
Writes fiction with a tint of horror. GGUF builds of Gemma 3 12B instruct, quantized with an imatrix made from a horror model, for creative writers who run mod…
New
Surya OCR 2.5
datalab-to · Kit
Reads text from document images with a 689M parameter model, and also finds text lines, layout blocks and reading order. Suits developers who turn scans and ph…
New
lift
datalab-to · Kit
Pulls structured data out of PDFs and images. You supply a JSON schema, and it returns an object that matches it. A 9.7B vision-language model from Datalab for…
New
PLLuM-12B-chat-2512
CYFRAGOVPL · Kit
A Polish-language chat model from the PLLuM family, tuned to human preferences for dialogue, question answering and summarization, with an eye on Polish public…
New
Qwen 3.6 35B-A3B REAP-48 v2 GGUF
crucible-labs · Kit
Runs a pruned and quantized Qwen3.6-35B-A3B in an 8.78 GiB GGUF file for llama.cpp, closer to the unquantized weights than the first release. For people with l…
New
Underdog-Woof-4B-1.1
ConwayResearch · Kit
Generates text as a compact 4.2B model, post-trained from Qwen 3 4B to work better with Underdog's own setup and quantized to 4-bit for MLX. For people running…
New
Instinct
continuedev · Kit
Predicts the next edit you are likely to make in your code. A 7.6B model from Continue, fine-tuned from Qwen2.5-Coder-7B, for developers who want to run it on…
New
ConeML 1.2B Experimental
ConeML · Kit
Names the tallest, oldest or first item among facts you supply, as a small English research model in FP32 Safetensors and Q8_0 GGUF files. For researchers, non…
New
North Mini Code
CohereLabs · Kit
An open-weights research model from Cohere for writing code, agentic software engineering and terminal tasks. A 30B model with 3B active, 256K context. For dev…
New
Chroma Context-1
chromadb · Kit
A 20B-parameter search model that finds supporting documents for complex, multi-step questions and trims its own working context as it goes. Meant to act as a…
New
Qwen3.5-9B GGUF (ShapeLearn)
byteshape · Kit
GGUF copies of Qwen3.5-9B, a model that reads text and images, compressed with ByteShape's ShapeLearn for llama.cpp. Variants for GPUs and CPUs, from about 3 G…
New
North-Mini-Code-1.0 GGUF
byteshape · Kit
GGUF copies of the North-Mini-Code-1.0 coding model, compressed with ByteShape's ShapeLearn for GPU use in llama.cpp. Four sizes from 12.1 GB to 21.5 GB, for d…
New
UI-TARS-1.5-7B
ByteDance-Seed · Kit
An open multimodal agent model that reads screenshots and decides what to do in apps, browsers, phones and games. For developers building computer-use and GUI…
New
Qwen3.5-4B GGUF
bartowski · Kit
Imatrix GGUF quantizations of Qwen3.5-4B, a 4.3B image-text model with MTP layers, with the 4-bit file near 3 GB. For people who run a small model locally.
New
MiniCPM5-2B-GGUF by bartowski
bartowski · Kit
Quantized GGUF copies of the MiniCPM5-2B text model in many sizes, made with llama.cpp and an importance matrix. For people running a small English and Chinese…
New
Llama-3.2-1B-Instruct GGUF
bartowski · Kit
GGUF quantizations of Llama-3.2-1B-Instruct, a 1.2B text model in eight languages, with the 4-bit file near 0.8 GB. For people who run a tiny local model.
New
gugujiji_novel-humanize-4b-GGUF
bartowski · Kit
Quantized GGUF copies of the novel-humanize-4b Chinese text model, offered in sizes from full precision down to small files. For people who run a 4B-parameter…
New
granite-4.2-3b-GGUF
bartowski · Kit
Quantized GGUF copies of IBM's granite-4.2-3b text model, in many sizes from full precision down to small 3-bit files. For people who run a small chat model on…
New
google_gemma-4-31B-it-GGUF
bartowski · Kit
Quantized GGUF files of Google's Gemma 4 31B instruction model, from 17.15 GB to 61.41 GB, made by bartowski with an importance matrix. Reads images and text.…
New
ERNIE-4.5-VL-28B-A3B-Thinking
baidu · Kit
Reads images and text and reasons about them, with about 3B of its 29.7B parameters active at a time. Covers chart reading, STEM problems from photos, visual g…
New
ERNIE-4.5-21B-A3B-Thinking
baidu · Kit
Reasoning-focused ERNIE 4.5 mixture-of-experts text model with 21B total and 3B active parameters, 128K context and tool calling, in English and Chinese. For d…
New
OvisOCR2
ATH-MaaS · Kit
Document parsing model that reads a page image and writes Markdown in reading order, covering text, formulas and tables. About 0.8B parameters, run through vLL…
New
Apodex-1.1-mini-GGUF
apodex · Kit
Reasoning model for long research tasks that works with files, data, code and tools, packaged as GGUF files you can host yourself. Suits researchers and develo…
New