AI projects from Hugging Face

Meta-Llama-3.1-8B-Instruct-AWQ-INT4

hugging-quants · Kit

Runs Meta's Llama 3.1 8B Instruct chat model in 4-bit AWQ form, so it fits on a GPU with about 4 GiB of free memory for the weights. For developers who want a…

officialmobai_Rostam-S1-4B-GGUF

bartowski · Kit

GGUF quantizations of Rostam-S1-4B, a 4B reasoning model for math, physics, software work and Persian-English text. For people who run small models locally and…

Hemmingway-1.5 GGUF

bartowski · Kit

Imatrix GGUF quantizations of HemmingwayAI's Hemmingway-1.5, a 27B text model with MTP speculative decoding and a reasoning-effort prompt format. For people wh…

AsteroRank-Lepton-GGUF

Asteromorph · Kit

Ranks search results by relevance with a reranker for STEM and general search, shipped as GGUF files for llama.cpp. For developers and researchers who want loc…

Swift 1.5 Ornith 9B GGUF

ukisai · Kit

Runs Swift 1.5 Ornith 9B, a reasoning model tuned to think with fewer tokens, as GGUF quantizations for llama.cpp. For people who run a 9B reasoning model on t…

Phi-4-mini-instruct

microsoft · Kit

A 3.8B open instruction model from Microsoft with a 128K token context, built for reasoning, math and logic in tight memory or latency budgets. It suits develo…

Qwen3.8-9B-Distill

empero-ai · Kit

Reasons step by step through math, code and general questions, opening each answer with a thinking block. A 9B Qwen3.5 model trained on traces from a larger Qw…

Ornith-1.5-35B-A3B-NVFP4

ornith-ai · Kit

Writes code and handles terminal agent tasks, a mixture-of-experts model using about 3B parameters per token, packaged as an NVFP4 copy. For developers hosting…

MN-Violet-Lotus-12B-GGUF

mradermacher · Kit

Static GGUF files of FallenMerick's MN-Violet-Lotus-12B in sizes from 4.9 GB to 13.1 GB. For people who run a 12B model on their own computer.

Ornith-1.5-9B-GGUF by AtomicChat

AtomicChat · Kit

GGUF builds of Ornith 1.5 9B, a model that reads images and text, in sizes from 2.81 GB to 17.9 GB plus a vision projector. Pick the file that fits your graphi…

Groot-19B-A3B-TTQ-GGUF

TokenTinkerer · Kit

Offers eleven GGUF sizes of the Groot-19B-A3B reasoning model for llama.cpp, from 7.88 to 18.59 GiB, plus a vision projector. Made for people who run the model…

Qwen3.5-4B-3D-Coder-GGUF

prithivMLmods · Kit

Writes code and builds interactive 3D scenes as self-contained Three.js pages, using GGUF copies of an early-preview Qwen3.5-4B fine-tune. For developers who p…

Qwen3.8-27B-DFlash2-GGUF by z-lab

z-lab · Kit

A draft model in GGUF form that speeds up Qwen3.8-27B by proposing token blocks for the main model to verify. For people who run that model locally with llama.…

LocalAlign_llama3.1_8B

yuyangGong · Kit

A LoRA adapter for Llama-3.1-8B-Instruct that trains it to follow trusted instructions and ignore commands hidden in external data. A prompt injection defense…

MiMo-V2.6-Pro-MOPD

XiaomiMiMo · Kit

Handles text, image, video and audio with a 1T-parameter mixture of experts tuned to repeat tool calls less in agent work. For teams that can host models of th…

Spark-X2.6-4B-FP8

XHToken · Kit

Compact 4.1B-parameter text model in FP8 form for on-device use, with three thinking levels (none, low, high) and English and Chinese support. Aimed at coding…

Spark-X2.6-1.7B-Base

XHToken · Kit

A compact 1.7B language model for on-device use in English and Chinese, with gains in coding, agent tasks and long context, and three adjustable thinking level…

Spark-X2.5-4B

XHToken · Kit

A compact 4.1B general-purpose language model with a native 1M-token context, over 200 languages and a hybrid attention design, tuned for coding and agent use.…

waqf-ocr-hand-written-v1

Waqf-AI · Kit

Reads handwritten Arabic text from images and returns it as text. A fine-tuned PaddleOCR-VL model for people digitizing Arabic handwriting.

SmolLM3-3B-GGUF

unsloth · Kit

Chats and reasons with SmolLM3, a fully open 3B model that can think step by step or answer directly, in GGUF files by Unsloth with chat template fixes. Handle…

Qwen3.6-35B-A3B-NVFP4-Fast

unsloth · Kit

Serves Qwen3.6 35B A3B in a fast NVFP4 build by Unsloth for vLLM on NVIDIA GPUs. The card says it has 1.79x the throughput of other NVFP4 builds and fits a 32…

Qwen3.6-27B-GGUF

unsloth · Kit

Handles agentic coding and image-plus-text tasks locally, as Unsloth's GGUF files for Qwen3.6-27B with thinking preservation and a long context. For developers…

Qwen3.5-4B-MTP-GGUF

unsloth · Kit

Unsloth's GGUF files of Qwen3.5-4B with multi-token prediction, which lets llama.cpp use speculative decoding for roughly 1.5 to 2 times faster generation. For…

Qwen3-30B-A3B-GGUF by unsloth

unsloth · Kit

GGUF files of Qwen3-30B-A3B, quantized by unsloth, for running a local chat and reasoning model in llama.cpp, Ollama or Open WebUI, with a thinking mode you ca…

Qwen3-14B-GGUF

unsloth · Kit

Gives you Qwen3 14B, a text generation model that can think through hard questions or answer fast, as GGUF files for your own computer. Packaged by unsloth for…

Qwen2.5-Coder-7B-Instruct-GGUF by unsloth

unsloth · Kit

Writes, explains and fixes code on your own computer, as Unsloth's GGUF copy of the Qwen2.5-Coder 7B instruction model. For developers who want a local coding…

Olmo-3-32B-Think-GGUF

unsloth · Kit

Gives you Olmo 3 32B Think, a 32.2B-parameter reasoning model, as GGUF files that run on your own computer. Packaged by unsloth for people who want a local mod…

Llama-3.2-3B-Instruct-GGUF by unsloth

unsloth · Kit

Chats, summarizes and answers questions with Meta's compact Llama 3.2 3B instruct model, in GGUF files by Unsloth from 2-bit up to 16-bit. Small enough for ord…

gpt-oss-120b-GGUF

unsloth · Kit

Runs OpenAI's open-weight gpt-oss-120b, a 117B model with 5.1B active parameters, from GGUF files by Unsloth that carry its fixes. Built for reasoning, agent t…

gemma-3-27b-it-GGUF

unsloth · Kit

Answers questions about text and images with Google's Gemma 3 27B instruction-tuned model, in GGUF files made by Unsloth for running on your own computer. It h…

gemma-3-270m-it-GGUF

unsloth · Kit

Generates text from prompts as a 268M instruction-tuned Gemma 3 model in GGUF format, small enough for laptops and desktops. For developers who want a tiny loc…

gemma-3-12b-it-GGUF

unsloth · Kit

Answers questions and summarizes text, and reads images, from GGUF files of Google's Gemma 3 12B instruction model. It suits people who want to run it on their…

ERNIE-4.5-21B-A3B-Thinking-GGUF

unsloth · Kit

Works through logic, math, science and coding problems with a 21B mixture-of-experts model that activates 3B parameters per token, in GGUF files by Unsloth. Su…

Torchcast Decision 4B

torchcast-ai · Kit

A 4B decision model built on Qwen3.5-4B that returns yes/no probabilities, choice distributions and score distributions in one pass without generating text. Fo…

MAI-UI-8B

Tongyi-MAI · Kit

Reads a screenshot and an instruction to decide what to tap or type on a phone or computer screen. An 8B model from the MAI-UI family of GUI agents, for develo…

Hy-MT2-1.8B-1.25Bit-GGUF

tencent · Kit

Translates between 33 languages on your own device with a 1.8B model squeezed to 1.25 bits, about 440 MB as GGUF files for llama.cpp. For developers adding off…

Hy-Memory-30B-A3B

tencent · Kit

Writes an assistant's long-term memory, choosing what to keep and how to update it inside Mem0, MemOS or Hy-Memory, with about 3B active parameters. For develo…

Qwen3.8-27B-Longbook27-v2

summerAIO · Kit

Summarizes, answers questions about and continues book-length text with a fine-tuned 27B model that uses Gated DeltaNet layers, in English and Japanese. For pe…

Mica v0.1 4B

sky7350 · Kit

Gives a probability for each allowed answer to a question about a given state, as yes/no, a choice or a score, without writing text. For developers who add qui…

Ornith-1.5-122B-NVFP4-DFlash2-RTX-Spark

Sherlock-Comms · Kit

Serves the 122B Ornith 1.5 model through vLLM with DFlash2 speculative decoding, using an unquantized output head. Made for RTX Spark laptops with 128 GB of me…

Sarvam-30B

sarvamai · Kit

A mixture-of-experts language model from Sarvam AI with 32.2B parameters and 2.4B active per token, built for practical use in English and many Indian language…

Sarvam-105B GGUF

sarvamai · Kit

The GGUF version of Sarvam-105B, a large mixture-of-experts model with a focus on Indian languages, split into 9 shards at 4-bit for llama.cpp. For people with…

Qwen3-4B P9 Honeypot

samliumay · Kit

A small research adapter for Qwen3-4B that turns the model into a decoy. It sends a silent alert to a local collector when it spots an attack on its secrets, t…

MiMo-V2.6-Distill-Qwen-9B-GSQ-RCO-GGUF

sainez · Kit

Gives you a 9B coding and tool-calling model as one 3.64 GiB GGUF file, quantized at about 3.5 bits per weight for running on your own machine.

Unlimited-OCR-2-GGUF

RX5950XT · Kit

GGUF files of the Unlimited-OCR-2 document OCR model in BF16, Q8_0 and Q4_K_M, with a vision projector. They run only in a llama.cpp build with the repository'…

Flint INT4

RecursiveSI · Kit

A 4-bit MLX copy of Recursive Flint for local use on Apple Silicon, about 22.6 GB, launched through Rec with pi or OpenCode. Suits Mac users and developers who…

gemma-4-31B-it-scotoma-2

ReadyArt · Kit

Text generation model of 31.3B parameters from ReadyArt, built on Google's gemma-4-31b-it and stored as Safetensors. Its page gives no statement of purpose, so…

Qwen3.8-27B-mixed-3.5bpw-MLX

rapid-mlx · Kit

A 27B vision-language model compressed to 3.5 bits per weight for Apple Silicon Macs with 24 GB of memory, served locally through Rapid-MLX. Suits Mac users an…

Qwen3.8-27B-NVFP4 by RadixArk

RadixArk · Kit

A pre-quantized NVFP4 copy of Qwen3.8-27B that reads text, images and video and answers in text, served with SGLang on NVIDIA Blackwell GPUs. Suits developers…

Qwen3.5-122B-A10B

Qwen · Kit

Reads images and text together and answers in text, as a mixture-of-experts model with 122B total and 10B active parameters. Suits teams with big GPU servers w…