AI projects from Hugging Face

Qwen3.8-27B-AWQ-INT4

cyankiwi · Kit

A 4-bit AWQ quantization of Qwen3.8-27B by cyankiwi, a 27B vision-language model with thinking control. Weights are 21.02 GB and load in Transformers, vLLM or…

Qwen3.6-35B-A3B MTP GGUF

byteshape · Kit

Runs Qwen3.6-35B-A3B from a GGUF quantization with Multi-Token Prediction for faster GPU decoding in llama.cpp. Made by ByteShape for people running local mode…

Nimble-v4-max

bespokelabs · Kit

Gives a probability for every answer option when you pass a context and typed questions such as choices, yes or no, or ordered scores. A fine-tune of Qwen3.8-2…

NorthCUA-Nano

beipo-ai · Kit

Operates desktop and browser apps from screenshots with a 9B dense computer-use model built on Qwen3.5. Suits developers who build computer-use agents with the…

Meta-Llama-3.1-8B-Instruct-GGUF

bartowski · Kit

Quantized GGUF files of Meta's Llama 3.1 8B Instruct for local chat, such as 4.92 GB for Q4_K_M and 8.54 GB for Q8_0. Made by bartowski with an importance matr…

Llama-3.2-3B-Instruct-GGUF

bartowski · Kit

GGUF quantizations of Meta's Llama-3.2-3B-Instruct, made by bartowski with an importance matrix, from about 1.8 GB to 6.4 GB. For running a small chat model lo…

KAT-Coder-V2.5-Dev GGUF

bartowski · Kit

Imatrix GGUF quantizations of Kwaipilot's KAT-Coder-V2.5-Dev, a 34.7B text model, with 4-bit files of about 19 GB or more. For people who run a large coder-nam…

Molmo2-4B

allenai · Kit

Answers questions about images, videos and groups of images, and can point to what it finds. An open vision-language model from Ai2 for developers and research…

Signal 3.8 27B

agentionai · Kit

Gives shorter, more direct answers than Qwen3.8-27B by using fewer answer and thinking tokens, so replies finish sooner. A light fine-tune that drops into the…

Smaug Humanizer

abacusai · Kit

Rewrites AI-written text in a human voice while keeping its facts, numbers, names and layout. A 12B model fine-tuned by Abacus.AI from Gemma 4, for writers and…

GLM-5.3-Flash-BF16

zai-org · Kit

A 320B-parameter multimodal model with 18B active that reads text and images, with an adjustable thinking budget and a hybrid attention design for long context…

GLM-5.2

zai-org · Kit

A 753B-parameter open text model from zai-org for long, multi-step work such as coding and agent tasks, with a 1M-token context and an MIT license. For teams w…

Forge-1-Gemma-4-E2B

YoSaNoo · Kit

A small coding-minded text model fine-tuned from Google's gemma-4-E2B and shared as GGUF files, so you can run it on your own laptop in Ollama, LM Studio, Unsl…

Spark-X2.6-1.7B-DSpark-GGUF

XHToken · Kit

A small draft model that speeds up Spark-X2.6-1.7B through speculative decoding, guessing up to seven tokens per step. For people who run that model locally on…

Llama-3.2-1B-Instruct-GGUF

unsloth · Kit

Chats, summarizes and answers questions in text on a laptop, as Unsloth's GGUF copy of Meta's small Llama 3.2 1B Instruct in precisions from 16-bit to 2-bit. F…

GLM-4-9B-0414-GGUF

unsloth · Kit

Generates text in Chinese and English from GGUF files of the 9.4B GLM-4-9B-0414 model, for people who want to run a GLM model on their own computer.

gemma-4-E2B-it-GGUF

unsloth · Kit

Unsloth's GGUF files of Google DeepMind's Gemma 4 E2B instruction-tuned model, which takes text and images and writes text, with a 128K context. For people who…

gemma-3-4b-it-GGUF

unsloth · Kit

Answers questions about text and images on your own computer, as a GGUF copy of Google's Gemma 3 4B instruction model packaged by Unsloth. For developers and u…

Inkling-Small-NVFP4

thinkingmachines · Kit

The NVFP4 copy of Inkling-Small, a multimodal mixture-of-experts model that takes text, images and audio and writes text. For developers building agents, codin…

gemma-4-31B-it-scotoma-2-GGUF

ReadyArt · Kit

Runs a 30.7B-parameter Gemma-based text model locally in GGUF format, packaged by ReadyArt from its gemma-4-31B-it-scotoma-2 model. Suits people who want that…

Qwen3.5-4B-Base

Qwen · Kit

Gives researchers a pre-trained-only vision-language base model for fine-tuning and in-context learning experiments, not for direct chat. Suits developers who…

Qwen3-4B-GGUF

Qwen · Kit

A 4B chat model in GGUF format that runs locally in llama.cpp or ollama, with a thinking mode for reasoning and a plain mode for quick replies. Suits developer…

Qwen3-14B

Qwen · Kit

Reasons through hard problems in a thinking mode and answers everyday chat in a faster non-thinking mode, as a 14.8B-parameter open model. Suits developers who…

Qwen2.5-Coder-32B-Instruct

Qwen · Kit

Writes, explains and fixes code as the largest instruction-tuned model in the Qwen2.5-Coder family, at 32B parameters. For developers who run a strong open cod…

Qwen2.5-Coder-14B-Instruct-GGUF

Qwen · Kit

Gives you the Qwen2.5-Coder 14B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp. For developers who want a stronger lo…

Qwen2.5-Coder-1.5B-Instruct-GGUF

Qwen · Kit

Gives you the small Qwen2.5-Coder 1.5B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp on a laptop. For developers who…

Ornith-1.5-9B

ornith-ai · Kit

Handles coding and terminal tasks as a 9B dense language model sized for a single GPU. For developers who want a small open model for software work, with a mob…

Ornith-1.5-122B-NVFP4

ornith-ai · Kit

Gives you an NVFP4 quantized copy of Ornith-1.5-122B, a 122B mixture-of-experts text model meant for single-GPU use and strong in coding tests. For developers…

MiniCPM-V 4.6

openbmb · Kit

Reads single images, several images and video and answers in text, with 1.3B parameters sized for phones and other edge devices. For developers who want a smal…

Naive-N0.5-Flash

NaiveAI · Kit

Open-weight mixture-of-experts model with 309B parameters, 15.5B active and a native 1M token context, built for coding and AI research. For teams running larg…

Qwen3.5-4B-GLB-3D-Coder-GGUF

mradermacher · Kit

Static GGUF quantizations of ccore/Qwen3.5-4B-GLB-3D-Coder, a 4.2B model, in sizes from 2.0 GB to 8.5 GB, plus two small multi-modal supplement files. Made by…

AREX-2 GGUF

mradermacher · Kit

GGUF quantized files of BAAI's AREX-2, a 26.9B model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit people who run a large model local…

Mellum2.1-12B-A2.5B-Thinking-GGUF

JetBrains · Kit

Runs JetBrains' 12B reasoning model locally in llama.cpp, Ollama or LM Studio, with five GGUF sizes to pick from. For developers who want a thinking model with…

Axion-1.0-35B-APEX-I-MiniPlus-V2.1-GGUF

IsValorum · Kit

Runs the 35B Axion-1.0 model locally in llama.cpp from one compressed GGUF file with mixed precision. A quantized release by IsValorum for people who want a la…

Ling-3.1-flash-1019

inclusionAI · Kit

Handles scientific and agentic tasks with 560B total and 25B active parameters and a 1M-token context, tuned further from Ling-3.1-flash. Serving examples use…

Granite-4.2-30B

ibm-granite · Kit

Works through a problem in steps before it answers, for math, code, tool calling and multilingual chat. IBM's largest dense Granite 4.2 model, under Apache 2.0…

SmolLM2-135M-Instruct

HuggingFaceTB · Kit

Answers chat-style questions and handles rewriting and summaries with a 135M-parameter instruction-tuned model small enough for on-device use. For developers w…

SmolLM2-1.7B-Instruct

HuggingFaceTB · Kit

Chats, rewrites and summarizes text and can call functions, in a compact 1.7B model small enough to run on-device. The instruction-tuned SmolLM2 from HuggingFa…

novel-humanize-4b

gugujiji · Kit

Rewrites Chinese web-novel chapters so they read less like AI output, keeping plot, dialogue and characters as they are. A 4B model built on Qwen3-4B, for non-…

gnani-evon-v3.3-30B-A3B

gnani · Kit

Chats, answers questions and reasons in English and ten Indic languages with a 128K context. A 30B mixture-of-experts model from Gnani.ai, for teams building a…

gpt-oss-20b-GGUF by ggml-org

ggml-org · Kit

Generates text on your own computer from a GGUF copy of OpenAI's gpt-oss-20b, packaged by ggml-org. For people who want to run an open 20B model locally in the…

Chandra OCR 2

datalab-to · Kit

Reads text from images and PDFs and returns markdown, HTML or JSON that keeps the page layout. Handles handwriting, forms, tables and math in 90+ languages, fo…

rakedoc-nano-2

cloudraker · Kit

Parses document page images into text, tables and charts with markdown formatting. A 1.2B-parameter model with better chart extraction, for developers building…

Qwen3.6-35B-A3B 2-bit GSQ GGUF

chtisgit · Kit

Runs a 35B Qwen model in a 2-bit GSQ GGUF conversion with a separate vision projector for llama.cpp. For people who want a large model in a small file on CPU o…

Qwen3.6-35B-A3B GGUF (ShapeLearn Quantized)

byteshape · Kit

Quantized GGUF versions of Qwen3.6-35B-A3B that read images and text, with CPU and GPU variants from about 9 GB, made with ByteShape's ShapeLearn. For develope…

FLUX 3 Image Klein Prompt Upsampler

black-forest-labs · Kit

A 9B model that turns a short image request, up to 10 reference images and optional bounding boxes into one detailed prompt for FLUX 3 Image Klein. For editing…

Spark-X2.6-4B GGUF

bartowski · Kit

Small English and Chinese chat model as GGUF files from full bf16 down to about 2.4 GB, for llama.cpp, with a low or high thinking setting. For developers who…

Qwen3.6-35B-A3B-coding-reap50-GGUF

anik-jha · Kit

Writes code with Qwen3.6-35B-A3B cut to half its experts and packed as GGUF files for llama.cpp. Made for developers who want a coding model that fits in less…

Kolibri-1

Aleph-Alpha · Kit

Reasons and calls tools in German and English, with a context window of more than a million tokens. An open 78B mixture-of-experts model from Aleph Alpha that…

Spark-X2.6-4B-DSpark-GGUF

XHToken · Kit

Speeds up text generation for Spark-X2.6-4B as a small draft model for speculative decoding, in GGUF format. Meant for people running that model locally with l…