AI projects from Hugging Face

Qwopus3.8-27B-Flash-GGUF

Jackrong · Kit

Cuts reasoning time and cost for long agent tasks, as a GGUF build of a Qwen3.8-27B fine-tune. Made for people who run agent loops on their own machine and wan…

Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Jackrong · Kit

Thinks through problems step by step inside think tags, as a 4B Qwen3.5 model fine-tuned on reasoning chains and packaged as GGUF. For people who run a small r…

MLX-Qwen3.5-0.8B-Claude-4.6-Opus-Reasoning-Distilled-6bit

Jackrong · Kit

Runs a tiny 0.8B reasoning-tuned chat model in the MLX format at 6-bit, converted from Jackrong's Qwen3.5 distilled model. For people who want a tiny local mod…

Qwen3.8-27B-NVFP4 Deployment Edition

IteraCompute · Kit

Serves Qwen3.8-27B in NVFP4 on one RTX 5090 with vLLM, with a checksum-verified download, FP8 KV cache, tool calls and reasoning support. For developers self-h…

Qwen3.6-35B-A3B-2Bit-GSQ

ISTA-DASLab · Kit

A 2-bit quantized copy of Qwen3.6-35B-A3B made with GSQ, a Gumbel-Softmax method, that keeps most reasoning and coding ability at a much smaller memory footpri…

Agents-A1

InternScience · Kit

Runs multi-step agent work: planning, search, tool calling and scientific reasoning, as a 35B open-weight language model. Built for developers who wire a model…

K2-Horizon-3.7B-GGUF

IFM · Kit

GGUF files of the 3.7B K2-Horizon text model in six precision levels, from BF16 to Q4_K_M, for running with llama.cpp. The model has a 512K-token context windo…

K2-Horizon-0.9B

IFM · Kit

Answers maths, coding and science questions as a compact open reasoning model that reads up to 128K tokens at once. Built by IFM for people who want a small mo…

ibnsina-1.5b

ibnsina-llm · Kit

A small Persian language model for writing, summarizing, translating and chatting offline, trained from scratch mostly on Persian text. Runs through ollama, LM…

granite-4.2-8b GGUF

ibm-granite · Kit

Holds GGUF copies of IBM's Granite 4.2 8B model in several quantization levels, ready for llama.cpp. For people who want to run the model locally and read its…

Granite-4.2-3B (GGUF)

ibm-granite · Kit

Packages IBM's Granite 4.2 3B text model as GGUF files for local use. The 4-bit weights are estimated at about 1.8 GB, for people who want a compact model unde…

Granite-4.0-H-350M

ibm-granite · Kit

Handles summaries, classification, extraction, question answering, RAG, code tasks and tool calling in 12 languages with a 340M-parameter instruct model from I…

ALLaM-7B-Instruct-preview

humain-ai · Kit

Answers questions and follows instructions in Arabic and English. A 7B model trained from scratch by the National Center for Artificial Intelligence at SDAIA,…

SmolVLM2-2.2B-Instruct

HuggingFaceTB · Kit

Answers questions about videos, images and text together, with a 2.2B model that needs about 5.2 GB of GPU memory for video. For developers building visual ass…

zephyr-7b-beta

HuggingFaceH4 · Kit

Chats as a helpful assistant, built by tuning Mistral-7B with direct preference optimization. For developers and hobbyists who want a small open chat model the…

Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

hesamation · Kit

Runs a reasoning-tuned Qwen3.6-35B-A3B on your own machine as GGUF files in four quant sizes, trained on Claude Opus 4.6 style reasoning data. For people who w…

H2O-Lightning-4B

h2oai · Kit

Answers typed decision questions about a document, ticket, policy or conversation, and about its images, giving each option a probability. For teams that want…

Tev-320B

gordonhu · Kit

A 320B mixture-of-experts agent model that works through long terminal tasks with a single bash tool. Trained with reinforcement learning on 1,170 environments…

gemma-4-31B-it-qat-q4_0-gguf

google · Kit

Runs Google's Gemma 4 31B instruction-tuned model as a 4-bit GGUF file that reads text and images and answers in text. It suits developers and enthusiasts with…

Qwen2.5-Coder-1.5B Q8_0 GGUF

ggml-org · Kit

Runs Qwen2.5-Coder 1.5B on your own machine as a Q8_0 GGUF file through llama.cpp, from the command line or as a local server. It suits developers who want a s…

Clef-GGUF

ggml-org · Kit

GGUF files of Cloudflare's Clef decision model, which takes image and text input. Served with llama.cpp tools and called through a decision API path. For devel…

KVARK Sparkle 1.0 (27B) FP8

Egzakta · Kit

Runs a 27B model that reads images and text, in FP8 for vLLM. It reasons with far fewer tokens than a Qwen model of the same size. Made for people who host the…

Kvark-Sparkle-1.0-27B

Egzakta · Kit

Reasons over images and text with fewer thinking tokens than its base Qwen3.8-27B, so answers arrive in about half the time at similar accuracy, per its card.…

Rukopys-OCR-4B

ebinan92 · Kit

Reads Ukrainian handwritten documents from images, finds each text region, labels its type and returns the transcriptions as structured JSON. An open 4B vision…

theOG-50M

DrunkkToys · Kit

Writes a Python function from a plain English request. A 50M parameter code model trained from scratch on one laptop, small enough to run offline in Ollama, LM…

Maple-Preview

deepgrove · Kit

A 20B ternary-weight reasoning model that activates about 1B parameters per token. Built for fast on-device use, with a 5.31 GB checkpoint and 131,072 token co…

Kiyo-65M

DedeProGames · Kit

Continues English text with a tiny 65M-parameter decoder-only model trained on 80B tokens. For learners and researchers who want a small transformers model to…

Gemma-3-12b-it-MAX-HORROR-Imatrix-GGUF

DavidAU · Kit

Writes fiction with a tint of horror. GGUF builds of Gemma 3 12B instruct, quantized with an imatrix made from a horror model, for creative writers who run mod…

Surya OCR 2.5

datalab-to · Kit

Reads text from document images with a 689M parameter model, and also finds text lines, layout blocks and reading order. Suits developers who turn scans and ph…

lift

datalab-to · Kit

Pulls structured data out of PDFs and images. You supply a JSON schema, and it returns an object that matches it. A 9.7B vision-language model from Datalab for…

PLLuM-12B-chat-2512

CYFRAGOVPL · Kit

A Polish-language chat model from the PLLuM family, tuned to human preferences for dialogue, question answering and summarization, with an eye on Polish public…

Qwen 3.6 35B-A3B REAP-48 v2 GGUF

crucible-labs · Kit

Runs a pruned and quantized Qwen3.6-35B-A3B in an 8.78 GiB GGUF file for llama.cpp, closer to the unquantized weights than the first release. For people with l…

Underdog-Woof-4B-1.1

ConwayResearch · Kit

Generates text as a compact 4.2B model, post-trained from Qwen 3 4B to work better with Underdog's own setup and quantized to 4-bit for MLX. For people running…

Instinct

continuedev · Kit

Predicts the next edit you are likely to make in your code. A 7.6B model from Continue, fine-tuned from Qwen2.5-Coder-7B, for developers who want to run it on…

ConeML 1.2B Experimental

ConeML · Kit

Names the tallest, oldest or first item among facts you supply, as a small English research model in FP32 Safetensors and Q8_0 GGUF files. For researchers, non…

North Mini Code

CohereLabs · Kit

An open-weights research model from Cohere for writing code, agentic software engineering and terminal tasks. A 30B model with 3B active, 256K context. For dev…

Chroma Context-1

chromadb · Kit

A 20B-parameter search model that finds supporting documents for complex, multi-step questions and trims its own working context as it goes. Meant to act as a…

Qwen3.5-9B GGUF (ShapeLearn)

byteshape · Kit

GGUF copies of Qwen3.5-9B, a model that reads text and images, compressed with ByteShape's ShapeLearn for llama.cpp. Variants for GPUs and CPUs, from about 3 G…

North-Mini-Code-1.0 GGUF

byteshape · Kit

GGUF copies of the North-Mini-Code-1.0 coding model, compressed with ByteShape's ShapeLearn for GPU use in llama.cpp. Four sizes from 12.1 GB to 21.5 GB, for d…

UI-TARS-1.5-7B

ByteDance-Seed · Kit

An open multimodal agent model that reads screenshots and decides what to do in apps, browsers, phones and games. For developers building computer-use and GUI…

Qwen3.5-4B GGUF

bartowski · Kit

Imatrix GGUF quantizations of Qwen3.5-4B, a 4.3B image-text model with MTP layers, with the 4-bit file near 3 GB. For people who run a small model locally.

MiniCPM5-2B-GGUF by bartowski

bartowski · Kit

Quantized GGUF copies of the MiniCPM5-2B text model in many sizes, made with llama.cpp and an importance matrix. For people running a small English and Chinese…

Llama-3.2-1B-Instruct GGUF

bartowski · Kit

GGUF quantizations of Llama-3.2-1B-Instruct, a 1.2B text model in eight languages, with the 4-bit file near 0.8 GB. For people who run a tiny local model.

gugujiji_novel-humanize-4b-GGUF

bartowski · Kit

Quantized GGUF copies of the novel-humanize-4b Chinese text model, offered in sizes from full precision down to small files. For people who run a 4B-parameter…

granite-4.2-3b-GGUF

bartowski · Kit

Quantized GGUF copies of IBM's granite-4.2-3b text model, in many sizes from full precision down to small 3-bit files. For people who run a small chat model on…

google_gemma-4-31B-it-GGUF

bartowski · Kit

Quantized GGUF files of Google's Gemma 4 31B instruction model, from 17.15 GB to 61.41 GB, made by bartowski with an importance matrix. Reads images and text.…

ERNIE-4.5-VL-28B-A3B-Thinking

baidu · Kit

Reads images and text and reasons about them, with about 3B of its 29.7B parameters active at a time. Covers chart reading, STEM problems from photos, visual g…

ERNIE-4.5-21B-A3B-Thinking

baidu · Kit

Reasoning-focused ERNIE 4.5 mixture-of-experts text model with 21B total and 3B active parameters, 128K context and tool calling, in English and Chinese. For d…

OvisOCR2

ATH-MaaS · Kit

Document parsing model that reads a page image and writes Markdown in reading order, covering text, formulas and tables. About 0.8B parameters, run through vLL…

Apodex-1.1-mini-GGUF

apodex · Kit

Reasoning model for long research tasks that works with files, data, code and tools, packaged as GGUF files you can host yourself. Suits researchers and develo…

Qwen3.8-27B-Quark-AWQ-MXFP4

amd · Kit

Runs Qwen3.8-27B as a smaller MXFP4-quantized copy made with AMD Quark and AWQ, served through vLLM. Made for developers who want a compressed 27B vision-langu…

AMALIA-9B-0626-DPO

amalia-llm · Kit

Writes and answers in European Portuguese as an open 9B chat model from Portuguese universities, tuned with supervised fine-tuning and DPO. Made for developers…

Olmo-3.1-32B-Think

allenai · Kit

Reasons step by step in English before it answers, which helps with math and coding questions. A 32B open model from allenai with published code, checkpoints a…

Surya 2.5 GGUF

datalab-to · Kit

Reads text, tables and layout from document images and returns it as text. GGUF builds of the Surya 2.5 OCR model for llama.cpp, for people who run document OC…

Qwen3.5-35B-A3B-GGUF

unsloth · Kit

Reads text and images, writes code and calls tools on your own machine, as Unsloth's refreshed GGUF files for the Qwen3.5 35B-A3B vision-language model. For de…

Hy-MT2-7B-GGUF

tencent · Kit

Translates text among 33 languages and follows translation instructions, as a GGUF copy of Tencent's 7B model for llama.cpp. For developers who run translation…

Hy-MT2-1.8B-GGUF

tencent · Kit

Translates text among 33 languages and obeys translation instructions, as a 1.8B model in GGUF format for llama.cpp. For developers who want a small local tran…

Qwen2.5-0.5B-Instruct

Qwen · Kit

Answers chat prompts as the smallest instruction-tuned Qwen2.5 model, at about 0.5B parameters. For developers who want a light local model for chat, structure…

MinerU2.5-Pro

opendatalab · Kit

Reads document page images and returns text, as a 1.2B-parameter model built for document parsing in Chinese and English. It suits teams that turn scanned page…

K2-Horizon-3.7B

IFM · Kit

Handles coding, reasoning and agent-style tasks as a small open model with a 512K token context window. Built by IFM for people who want public training data,…

DialFork Leaderboard

DialFork · Kit

Lists how different methods score on DialFork, a benchmark for procedural hallucination in conversational AI agents, on one static page. It suits researchers w…

Molmo2-8B

allenai · Kit

Answers questions about images, video and several images at once, and can point to things it finds. Made for developers who want an open 8B vision-language mod…

BaronLLM Offensive Security LLM Q6_K GGUF

AlicanKiraz0 · Kit

Answers security questions and helps plan authorized red-team exercises, as a Q6_K GGUF fine-tune of Llama 3.1 8B. For security researchers working on systems…

GigaChat3.5-432B-A28B

ai-sage · Kit

Generates text in Russian and English for chat, code, reasoning and tool use. A 432B Mixture-of-Experts model with 28B active parameters, aimed at teams that h…

GigaChat3.1-10B-A1.8B-GGUF

ai-sage · Kit

Chats in Russian and English, writes code and calls functions, as a compact mixture of experts model in GGUF files. For people who run assistants on their own…

Ara-JEV

AhmedReda25300 · Kit

Picks the best answer label from a short Arabic situation, a question and optional choices. Made for developers who route or decide Arabic tasks with a small 0…

Qwen3.8-27B Agention Precision GGUF

agentionai · Kit

Packs Qwen3.8-27B as llama.cpp GGUF files in eight sizes from 8.95 to 16.35 GiB, plus a vision projector. The author reports less drift from the BF16 model tha…

Occamy-1.0

Accio-Lab · Kit

An open 35B image and text model from Accio-Lab, based on Qwen3.6-35B-A3B, in BF16, GGUF, FP8, NVFP4 and MLX formats. For teams that serve a large model.

GLM-5.3-Flash EXL3 Spark

0xSero · Kit

Runs GLM-5.3-Flash with a 256k-token context and image input on one DGX Spark, using a mixed 2.31 bits-per-weight EXL3 build. For people hosting a large model…

Qwen3.8-Flash-Next-125B-UltraLite-37GiB-GGUF

0xKitkat · Kit

Squeezes the Qwen3.8-Flash-Next mixture-of-experts model into about 37 GiB of text-only GGUF files for experiments. It needs a patched llama.cpp build that com…

Tessera-27B-B-CJK-RL

ZelligeAI · Kit

Runs coding-agent loops with a 27B model that thinks in a compressed English and Chinese shorthand, so it spends fewer thinking tokens per turn. For developers…

AgentForesight-7B

ZBox008003 · Kit

Audits a multi-agent run while it unfolds and flags the earliest decisive error, naming the step, the agent and a short reason. For developers who build and de…

Strata-Sage-A1.5-GGUF

ykarout · Kit

A Q4_K_M GGUF of the 35B Sage-A1.5 model made for the Strata inference engine, fitting a full 262K context on a 16 GB graphics card plus 64 GB of RAM. For peop…

OpenBonsai Qwen3.5-9B Ternary

webbrain-one · Kit

Runs Qwen3.5-9B squeezed to ternary weights in a roughly 2 GB GGUF file, for CPU use in two llama.cpp variants. A research preview for people who experiment wi…

Qwen3.6-27B-MTP-GGUF

unsloth · Kit

Codes and reasons with Qwen3.6 27B in GGUF files by Unsloth that carry multi-token prediction, which the card says speeds up replies about 1.5 to 2 times with…

Qwen3.5-0.8B-MTP-GGUF

unsloth · Kit

Runs the small Qwen3.5 0.8B vision-language model in llama.cpp with multi-token prediction for faster generation, as Unsloth's GGUF files. For developers testi…

Muse Glimmer 30B GGUF

unsloth · Kit

Runs a 30B agent model locally that reads text and images, calls tools and retries failed calls, from Unsloth's GGUF files. For developers building local agent…

granite-4.1-8b-GGUF

unsloth · Kit

Follows instructions, calls tools and chats with IBM's Granite 4.1 8B model, in GGUF files by Unsloth that include chat template fixes. Made for business assis…

gemma-4-31B-it-qat-GGUF

unsloth · Kit

Runs Google's Gemma 4 31B instruction model from Unsloth's 4-bit QAT GGUF files, with an included drafter for faster speculative decoding in llama.cpp. For peo…

NeoHorse-1-9B

TokenRhythm · Kit

A 9B text model post-trained from Qwen3.5-9B for agent frameworks, tool use, coding and instruction following, released as text-only weights. For developers wh…

MNN-Pocket-0.3B-Base

taobao-mnn · Kit

A pre-trained base language model of about 300M parameters for Chinese and English, designed with the MNN inference engine for on-device use, as a start for fu…

Beam-1.0-501B-A23B-NVFP4

reflection · Kit

Reads and writes text with a 1M-token context, built for coding, agent tool use and math reasoning, as a 501B-parameter mixture-of-experts model in NVFP4 form.…

Flint NVFP4 GGUF

RecursiveSI · Kit

A 4-bit NVFP4 copy of the Recursive Flint text model as one GGUF file, built for NVIDIA GPUs through llama.cpp. For developers running a large local model with…

Qwen3Guard-Gen-0.6B

Qwen · Kit

A small safety moderation model that labels a prompt or a model reply as safe, controversial or unsafe and names the risk categories, in 119 languages. Suits d…

Qwen3-1.7B-GGUF

Qwen · Kit

Gives you the small Qwen3 1.7B chat model as a q8_0 GGUF file for llama.cpp, with a switch between thinking and non-thinking replies. For people who want a lig…

Qwen3-1.7B-Base

Qwen · Kit

Continues text and code as a 1.7B base language model pre-trained on 119 languages. For developers who want a small model to fine-tune or test.

Qwen3-1.7B

Qwen · Kit

A compact 1.7B chat model that switches between a thinking mode for reasoning and a quick mode for dialogue. Suits developers who want a small open model for c…

Qwen2.5-VL-7B-Instruct

Qwen · Kit

A vision-language model that reads images, documents and video together with a text question and answers in text. Suits developers who build apps around charts…

Qwen2.5-Coder-14B-Instruct

Qwen · Kit

A 14.8B code model tuned to follow instructions. It writes, explains and fixes code from plain requests, and runs through the transformers library. Suits devel…

Qwen2.5-7B-Instruct

Qwen · Kit

Chats, writes code, solves maths and returns structured JSON as a 7.6B-parameter instruction-tuned model with a context window up to 131,072 tokens. Suits deve…

Qwen2 0.5B Instruct

Qwen · Kit

A small 494M-parameter chat model from Qwen that follows instructions, with weights of about 988 MB in BF16 that run through Transformers. It suits developers…

1-bit Bonsai 27B (MLX)

prism-ml · Kit

Runs a 27B-class reasoning model packed to 1 bit per weight, about 3.9 GB, on Apple MLX, with 262K-token context. For developers who want a large model on a ph…

Bonsai-1.7B-GGUF

prism-ml · Kit

Generates text with a 1.7B language model packed to 1 bit per weight, about 0.24 GB, for llama.cpp on CUDA, Metal and CPU. For developers who need a tiny local…

Laguna XS 2.1

poolside · Kit

Writes code and works through long coding tasks with tool calls, using a 33B mixture-of-experts model that activates 3B parameters per token. For developers wh…

Qwen3.8-27B-QSA-GSQ-RCO-GGUF

pentacoxian-dev · Kit

Runs Qwen3.8-27B with sparse attention on a single 24 GB GPU at a 262K-token context with image input, as GGUF files for people with a custom llama.cpp engine…

Ornith-1.0-9B-GGUF

ornith-ai · Kit

GGUF copy of a 9B open-source coding-agent model, trained with reinforcement learning to write solutions and the scaffolding around them. Built for single-GPU…

MiniCPM-V-4.7-1B-gguf

openbmb · Kit

Runs a 1B vision-language model through llama.cpp, answering text prompts about images. GGUF files in many quant sizes, for developers and hobbyists who want a…

gpt-oss-safeguard-20b

openai · Kit

Classifies text against a safety policy you write and shows its reasoning. For trust and safety teams filtering model inputs and outputs, labeling content onli…

gpt-oss-safeguard-120b

openai · Kit

Sorts text against a safety policy that you write, and shows its reasoning for each decision. It suits trust and safety teams that filter or label content.

OneJev1.6-4B

OmniJev · Kit

Reads a screenshot, photo, video or text with a few typed questions and returns a probability for each answer option in one pass. Built for developers of scree…