AI projects from Hugging Face

gemma-4-26B-A4B-it Cactus CQ

Cactus-Compute · Kit

2-bit, 3-bit and 4-bit compressed copies of Google's gemma-4-26B-A4B-it chat model in the Cactus weights format. Built to run on ARM devices through the Cactus…

Spark-X2.6-4B-FP8

XHToken · Kit

Compact 4.1B-parameter text model in FP8 form for on-device use, with three thinking levels (none, low, high) and English and Chinese support. Aimed at coding…

Spark-X2.6-1.7B-Base

XHToken · Kit

A compact 1.7B language model for on-device use in English and Chinese, with gains in coding, agent tasks and long context, and three adjustable thinking level…

Indic Tiny TTS: Hindi

sulabhkatiyar · Kit

Reads Hindi text in Devanagari script aloud with a female or a male voice, small enough to run on a CPU without a GPU. Made for developers adding Hindi speech…

Chatterbox-Nano

ResembleAI · Kit

Speaks English text aloud on a plain CPU with a 110M-parameter model, and adds laughs and coughs through tags in the text. Suits developers who need fast on-de…

Gemma 4 12B IT (LiteRT-LM)

litert-community · Kit

Runs Gemma 4 12B on your own desktop with text, image and audio input, no internet needed. A LiteRT-LM build for developers who want private, on-device generat…

Granite-4.0-H-350M

ibm-granite · Kit

Handles summaries, classification, extraction, question answering, RAG, code tasks and tool calling in 12 languages with a 340M-parameter instruct model from I…

SmolVLM2-2.2B-Instruct

HuggingFaceTB · Kit

Answers questions about videos, images and text together, with a 2.2B model that needs about 5.2 GB of GPU memory for video. For developers building visual ass…

Maple-Preview

deepgrove · Kit

A 20B ternary-weight reasoning model that activates about 1B parameters per token. Built for fast on-device use, with a 5.31 GB checkpoint and 131,072 token co…

MiniCPM5-2B-GGUF by bartowski

bartowski · Kit

Quantized GGUF copies of the MiniCPM5-2B text model in many sizes, made with llama.cpp and an importance matrix. For people running a small English and Chinese…

SmolLM2-360M

HuggingFaceTB · Kit

Continues English text from a prompt with a 362M-parameter base language model trained on 4 trillion tokens and light enough for on-device use. For developers…

Smaug-Decisions

abacusai · Kit

Answers a typed question about audio, an image or text with a probability for each option, in one pass and with no generated text. A 4B decision model fine-tun…

Zabibu Fikra Model 2 (4B)

zabibutechnika · Kit

Answers in Swahili and English from a 4B model made to run privately on your own device, offline. Suits on-device assistants that need African context, such as…

MNN-Pocket-0.3B-Base

taobao-mnn · Kit

A pre-trained base language model of about 300M parameters for Chinese and English, designed with the MNN inference engine for on-device use, as a start for fu…

1-bit Bonsai 27B (MLX)

prism-ml · Kit

Runs a 27B-class reasoning model packed to 1 bit per weight, about 3.9 GB, on Apple MLX, with 262K-token context. For developers who want a large model on a ph…

Bonsai-1.7B-GGUF

prism-ml · Kit

Generates text with a 1.7B language model packed to 1 bit per weight, about 0.24 GB, for llama.cpp on CUDA, Metal and CPU. For developers who need a tiny local…

Gemma 4 E4B IT (LiteRT-LM)

litert-community · Kit

Runs a small Gemma 4 model on phones, desktops, IoT boards and the web without an internet connection. A 3.66 GB LiteRT-LM build for developers who want privat…

Spark-X2.6-4B-AgentFast

JamieBradfield · Kit

Calls tools and follows instructions with almost no thinking delay, as a 4.1B fine-tune of Spark-X2.6-4B. Made for people building fast local agents that need…

SmolLM2-135M

HuggingFaceTB · Kit

Continues English text from a prompt with a 135M-parameter base language model small enough to run on-device. For developers who want a tiny model to test idea…

POCKET-35B-GGUF

FINAL-Bench · Kit

Runs a Korean-tuned 35B model on your own PC from GGUF files with llama.cpp, with a CPU-only path so no GPU is needed. For people who want a local language mod…