AI projects from Hugging Face

Swift 1.5 Ornith 9B GGUF

ukisai · Kit

Runs Swift 1.5 Ornith 9B, a reasoning model tuned to think with fewer tokens, as GGUF quantizations for llama.cpp. For people who run a 9B reasoning model on t…

Llama-3.1-8B-Stheno-v3.4

Sao10K · Kit

Writes stories and plays characters in multi-turn chat. An 8B Llama 3.1 fine-tune for creative writing and roleplay, aimed at hobbyists who run models on their…

MiMo-V2.6-Distill-Qwen-9B-GSQ-RCO-GGUF

sainez · Kit

Gives you a 9B coding and tool-calling model as one 3.64 GiB GGUF file, quantized at about 3.5 bits per weight for running on your own machine.

Qwen3-30B-A3B-GGUF

Qwen · Kit

A 30.5B mixture-of-experts chat model in GGUF format with only 3.3B parameters active per token, runnable in llama.cpp or ollama. It has thinking and plain mod…

Qwen2.5-Coder-32B-Instruct-GGUF

Qwen · Kit

GGUF copy of a 32B code chat model that runs locally with llama.cpp. It writes, explains and fixes code from plain requests, for developers who want to run it…

AstrLink Guard

QuantumNous · Kit

Finds personal information and credentials in Chinese, English and mixed text, code, logs and AI coding assistant requests, locally in ONNX. For developers who…

PP-OCRv6_small_rec

PaddlePaddle · Kit

Reads text from images in English and Chinese, the small model in the PP-OCRv6 family for PaddleOCR. For developers who want compact OCR on their own machines.

MiniCPM-OCR 1.0 GGUF

openbmb · Kit

Reads English and Chinese documents, including PDFs, into text, tables and formulas, in GGUF files for llama.cpp. For people who run MiniCPM-OCR 1.0 on their o…

Hermes-4.3-36B-GGUF

NousResearch · Kit

A 36B hybrid reasoning model in GGUF form that can think before it answers, write valid JSON and follow your system prompt. For people who run a large model on…

nomic-embed-text-v1.5-GGUF

nomic-ai · Kit

Turns sentences into vectors on your own machine through llama.cpp, using compact GGUF files, for search and RAG questions. For developers who want local text…

JevK5-chat-mlx-4bit

mlx-community · Kit

A 4-bit MLX copy of the 4.2B JevK5 chat model for Apple Silicon, with a 262,144 token context and a small memory footprint. Made for Mac users who want a quick…

GLM-5.3-Flash EXL3 4bpw for TensorFold

Mia-AiLab · Kit

4-bit EXL3 quantization of GLM-5.3-Flash prepared for TensorFold, with lower KL divergence than a popular TR3-4bpw quant at the same size. For people serving l…

Qwopus3.8-27B-Flash-GGUF

Jackrong · Kit

Cuts reasoning time and cost for long agent tasks, as a GGUF build of a Qwen3.8-27B fine-tune. Made for people who run agent loops on their own machine and wan…

Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

hesamation · Kit

Runs a reasoning-tuned Qwen3.6-35B-A3B on your own machine as GGUF files in four quant sizes, trained on Claude Opus 4.6 style reasoning data. For people who w…

MuLaCover by HeartMuLa

HeartMuLa · Kit

Makes cover songs and music remixes from a reference track, lyrics and a style prompt, or from melody and chord MIDI. Writes a WAV file. For noncommercial musi…

Qwen2.5-Coder-1.5B Q8_0 GGUF

ggml-org · Kit

Runs Qwen2.5-Coder 1.5B on your own machine as a Q8_0 GGUF file through llama.cpp, from the command line or as a local server. It suits developers who want a s…

Clef-GGUF

ggml-org · Kit

GGUF files of Cloudflare's Clef decision model, which takes image and text input. Served with llama.cpp tools and called through a decision API path. For devel…

Instinct

continuedev · Kit

Predicts the next edit you are likely to make in your code. A 7.6B model from Continue, fine-tuned from Qwen2.5-Coder-7B, for developers who want to run it on…

wan-gguf

calcuis · Kit

GGUF quantized versions of the Wan video models for text-to-video work in ComfyUI or diffusers, including small 1.3b files for older machines. For people who m…

pig-vae

calcuis · Kit

A small GGUF VAE in the pig architecture for image and video workflows, with a loader in the gguf-node package. Aimed at faster runs and lower memory use on ol…