AI projects from Hugging Face

Qwen3-30B-A3B-GGUF by unsloth

unsloth · Kit

GGUF files of Qwen3-30B-A3B, quantized by unsloth, for running a local chat and reasoning model in llama.cpp, Ollama or Open WebUI, with a thinking mode you ca…

Qwen3-14B-GGUF

unsloth · Kit

Gives you Qwen3 14B, a text generation model that can think through hard questions or answer fast, as GGUF files for your own computer. Packaged by unsloth for…

Llama-3.2-3B-Instruct-GGUF by unsloth

unsloth · Kit

Chats, summarizes and answers questions with Meta's compact Llama 3.2 3B instruct model, in GGUF files by Unsloth from 2-bit up to 16-bit. Small enough for ord…

gpt-oss-120b-GGUF

unsloth · Kit

Runs OpenAI's open-weight gpt-oss-120b, a 117B model with 5.1B active parameters, from GGUF files by Unsloth that carry its fixes. Built for reasoning, agent t…

gemma-3-270m-it-GGUF

unsloth · Kit

Generates text from prompts as a 268M instruction-tuned Gemma 3 model in GGUF format, small enough for laptops and desktops. For developers who want a tiny loc…

ERNIE-4.5-21B-A3B-Thinking-GGUF

unsloth · Kit

Works through logic, math, science and coding problems with a 21B mixture-of-experts model that activates 3B parameters per token, in GGUF files by Unsloth. Su…

Hy-Memory-30B-A3B

tencent · Kit

Writes an assistant's long-term memory, choosing what to keep and how to update it inside Mem0, MemOS or Hy-Memory, with about 3B active parameters. For develo…

Qwen3.8-27B-Longbook27-v2

summerAIO · Kit

Summarizes, answers questions about and continues book-length text with a fine-tuned 27B model that uses Gated DeltaNet layers, in English and Japanese. For pe…

Mica v0.1 4B

sky7350 · Kit

Gives a probability for each allowed answer to a question about a given state, as yes/no, a choice or a score, without writing text. For developers who add qui…

BeeLLM

schizophyllume · Kit

Offers a family of tiny GGUF language models that talk in bee buzzes, from buzz-only bees to mood-tagged ones and linked queen and worker hives. For hobbyists…

Sarvam-30B

sarvamai · Kit

A mixture-of-experts language model from Sarvam AI with 32.2B parameters and 2.4B active per token, built for practical use in English and many Indian language…

Sarvam-105B GGUF

sarvamai · Kit

The GGUF version of Sarvam-105B, a large mixture-of-experts model with a focus on Indian languages, split into 9 shards at 4-bit for llama.cpp. For people with…

Qwen3-4B P9 Honeypot

samliumay · Kit

A small research adapter for Qwen3-4B that turns the model into a decoy. It sends a silent alert to a local collector when it spots an attack on its secrets, t…

MiMo-V2.6-Distill-Qwen-9B-GSQ-RCO-GGUF

sainez · Kit

Gives you a 9B coding and tool-calling model as one 3.64 GiB GGUF file, quantized at about 3.5 bits per weight for running on your own machine.

Flint INT4

RecursiveSI · Kit

A 4-bit MLX copy of Recursive Flint for local use on Apple Silicon, about 22.6 GB, launched through Rec with pi or OpenCode. Suits Mac users and developers who…

gemma-4-31B-it-scotoma-2

ReadyArt · Kit

Text generation model of 31.3B parameters from ReadyArt, built on Google's gemma-4-31b-it and stored as Safetensors. Its page gives no statement of purpose, so…

Qwen3-8B-MLX-bf16

Qwen · Kit

Runs the Qwen3 8B language model through the mlx library for chat, reasoning, translation and agent work. Suits developers who want a local text model with a s…

Qwen3-30B-A3B-GGUF

Qwen · Kit

A 30.5B mixture-of-experts chat model in GGUF format with only 3.3B parameters active per token, runnable in llama.cpp or ollama. It has thinking and plain mod…

Qwen3-0.6B-GGUF

Qwen · Kit

A small 0.6B chat model in GGUF format that runs locally in llama.cpp or ollama and can switch between thinking and plain replies. Suits people with modest har…

Qwen2.5-Coder-7B

Qwen · Kit

Completes and generates code as a 7.6B base language model that developers can run, fine-tune or use for fill in the middle tasks. Built for people making codi…