AI projects from Hugging Face

Ornith-1.5-122B-NVFP4-DFlash2-RTX-Spark

Sherlock-Comms · Kit

Serves the 122B Ornith 1.5 model through vLLM with DFlash2 speculative decoding, using an unquantized output head. Made for RTX Spark laptops with 128 GB of me…

Sarvam-30B

sarvamai · Kit

A mixture-of-experts language model from Sarvam AI with 32.2B parameters and 2.4B active per token, built for practical use in English and many Indian language…

Sarvam-105B GGUF

sarvamai · Kit

The GGUF version of Sarvam-105B, a large mixture-of-experts model with a focus on Indian languages, split into 9 shards at 4-bit for llama.cpp. For people with…

Qwen3-4B P9 Honeypot

samliumay · Kit

A small research adapter for Qwen3-4B that turns the model into a decoy. It sends a silent alert to a local collector when it spots an attack on its secrets, t…

MiMo-V2.6-Distill-Qwen-9B-GSQ-RCO-GGUF

sainez · Kit

Gives you a 9B coding and tool-calling model as one 3.64 GiB GGUF file, quantized at about 3.5 bits per weight for running on your own machine.

Unlimited-OCR-2-GGUF

RX5950XT · Kit

GGUF files of the Unlimited-OCR-2 document OCR model in BF16, Q8_0 and Q4_K_M, with a vision projector. They run only in a llama.cpp build with the repository'…

Flint INT4

RecursiveSI · Kit

A 4-bit MLX copy of Recursive Flint for local use on Apple Silicon, about 22.6 GB, launched through Rec with pi or OpenCode. Suits Mac users and developers who…

gemma-4-31B-it-scotoma-2

ReadyArt · Kit

Text generation model of 31.3B parameters from ReadyArt, built on Google's gemma-4-31b-it and stored as Safetensors. Its page gives no statement of purpose, so…

Qwen3.8-27B-mixed-3.5bpw-MLX

rapid-mlx · Kit

A 27B vision-language model compressed to 3.5 bits per weight for Apple Silicon Macs with 24 GB of memory, served locally through Rapid-MLX. Suits Mac users an…

Qwen3.8-27B-NVFP4 by RadixArk

RadixArk · Kit

A pre-quantized NVFP4 copy of Qwen3.8-27B that reads text, images and video and answers in text, served with SGLang on NVIDIA Blackwell GPUs. Suits developers…

Qwen3.5-122B-A10B

Qwen · Kit

Reads images and text together and answers in text, as a mixture-of-experts model with 122B total and 10B active parameters. Suits teams with big GPU servers w…

Qwen3-8B-MLX-bf16

Qwen · Kit

Runs the Qwen3 8B language model through the mlx library for chat, reasoning, translation and agent work. Suits developers who want a local text model with a s…

Qwen3-30B-A3B-GGUF

Qwen · Kit

A 30.5B mixture-of-experts chat model in GGUF format with only 3.3B parameters active per token, runnable in llama.cpp or ollama. It has thinking and plain mod…

Qwen3-0.6B-GGUF

Qwen · Kit

A small 0.6B chat model in GGUF format that runs locally in llama.cpp or ollama and can switch between thinking and plain replies. Suits people with modest har…

Qwen2.5-Coder-7B

Qwen · Kit

Completes and generates code as a 7.6B base language model that developers can run, fine-tune or use for fill in the middle tasks. Built for people making codi…

Qwen2.5-Coder-32B-Instruct-GGUF

Qwen · Kit

GGUF copy of a 32B code chat model that runs locally with llama.cpp. It writes, explains and fixes code from plain requests, for developers who want to run it…

Qwen2.5-Coder-0.5B-Instruct

Qwen · Kit

Writes, explains and fixes code as a tiny 494M-parameter chat model with a 32,768-token context. Suits developers who want the smallest open Qwen coding model…

Qwen2.5-7B-Instruct-AWQ

Qwen · Kit

A 4-bit AWQ build of Qwen2.5-7B-Instruct, a 7.6B chat model that follows instructions, handles tables and returns JSON. For developers who want a capable chat…

Qwen2.5-14B-Instruct

Qwen · Kit

Answers questions, writes code, does maths and returns structured JSON as a 14.7B-parameter chat model with a context window up to 131,072 tokens. Suits develo…

Qwen2.5-0.5B

Qwen · Kit

The smallest base model in Qwen2.5, about 494M parameters with a 32,768-token context, meant for further training on your own data. For developers who want a t…