AI projects from Hugging Face

ColGrep-Agent-2B

lightonai · Kit

A 2.5B-parameter model that finds the files and line ranges relevant to a bug report or question about a code repository, by searching and reading the repo. Ru…

Qwen3.8-27B-oQ8e-mtp

Jundot · Kit

Runs Qwen3.8-27B as an 8-bit mixed-precision MLX checkpoint with its vision encoder and MTP head, for image and text chat on Apple hardware. For people who wan…

humanizer-GGUF

jialinyyzz · Kit

Rewrites AI-written drafts in English and Chinese so they read like a person wrote them, keeping numbers, dates, names and quotes. A 12B model in GGUF files fo…

MLX-Qwen3.5-0.8B-Claude-4.6-Opus-Reasoning-Distilled-6bit

Jackrong · Kit

Runs a tiny 0.8B reasoning-tuned chat model in the MLX format at 6-bit, converted from Jackrong's Qwen3.5 distilled model. For people who want a tiny local mod…

granite-4.2-8b GGUF

ibm-granite · Kit

Holds GGUF copies of IBM's Granite 4.2 8B model in several quantization levels, ready for llama.cpp. For people who want to run the model locally and read its…

Granite-4.2-3B (GGUF)

ibm-granite · Kit

Packages IBM's Granite 4.2 3B text model as GGUF files for local use. The 4-bit weights are estimated at about 1.8 GB, for people who want a compact model unde…

Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

hesamation · Kit

Runs a reasoning-tuned Qwen3.6-35B-A3B on your own machine as GGUF files in four quant sizes, trained on Claude Opus 4.6 style reasoning data. For people who w…

phonon-31m English for llama.cpp

gradium · Kit

Turns English text into speech from the command line or a local server, as a GGUF copy of the Phonon 31M model for llama.cpp. It suits developers who already r…

Qwen2.5-Coder-1.5B Q8_0 GGUF

ggml-org · Kit

Runs Qwen2.5-Coder 1.5B on your own machine as a Q8_0 GGUF file through llama.cpp, from the command line or as a local server. It suits developers who want a s…

embeddinggemma-2 GGUF

ggml-org · Kit

Runs a GGUF copy of Google's embeddinggemma-2, a 271M feature extraction model, with the llama command or the Llama app. For developers who want a small text e…

GLiNER2.5-multi-Decide

fastino · Kit

Classifies text into labels you pass at call time, in one pass and with no prompt template. A 287M model for routing, intent, sentiment and moderation on non-E…

Gemma-3-12b-it-MAX-HORROR-Imatrix-GGUF

DavidAU · Kit

Writes fiction with a tint of horror. GGUF builds of Gemma 3 12B instruct, quantized with an imatrix made from a horror model, for creative writers who run mod…

Qwen3-ASR-1.7B GGUF

cstr · Kit

Turns speech, singing and songs into text, or into English, with quantized GGUF files of Qwen3-ASR-1.7B for CrispASR. For people who want local transcription a…

Underdog-Woof-4B-1.1

ConwayResearch · Kit

Generates text as a compact 4.2B model, post-trained from Qwen 3 4B to work better with Underdog's own setup and quantized to 4-bit for MLX. For people running…

wan-gguf

calcuis · Kit

GGUF quantized versions of the Wan video models for text-to-video work in ComfyUI or diffusers, including small 1.3b files for older machines. For people who m…

SalamandraTA-7b-instruct

BSC-LT · Kit

A 7.8B translation model for 40 languages and 3 varieties, covering sentence, paragraph and document translation plus HTML or XML text. For developers and rese…

Qwen3.5-4B GGUF

bartowski · Kit

Imatrix GGUF quantizations of Qwen3.5-4B, a 4.3B image-text model with MTP layers, with the 4-bit file near 3 GB. For people who run a small model locally.

Llama-3.2-1B-Instruct GGUF

bartowski · Kit

GGUF quantizations of Llama-3.2-1B-Instruct, a 1.2B text model in eight languages, with the 4-bit file near 0.8 GB. For people who run a tiny local model.

Qwen3.8-Whittle-MoE-27B-MLX-4bit

barozp · Kit

A 4-bit MLX build for Apple Silicon of a mixture-of-experts model carved from the dense Qwen3.8-27B, with 17.8B active of 27B total parameters. For people who…

MOSS-Image-SFT GGUF

axiomofmind · Kit

Unofficial GGUF files of the MOSS-Image-SFT diffusion transformer in Q8_0 and Q4_K_S, for running text-to-image locally with stable-diffusion.cpp. Needs a sepa…

Qwen3.5-35B-A3B-GGUF

unsloth · Kit

Reads text and images, writes code and calls tools on your own machine, as Unsloth's refreshed GGUF files for the Qwen3.5 35B-A3B vision-language model. For de…

Hy-MT2-7B-GGUF

tencent · Kit

Translates text among 33 languages and follows translation instructions, as a GGUF copy of Tencent's 7B model for llama.cpp. For developers who run translation…

Hy-MT2-1.8B-GGUF

tencent · Kit

Translates text among 33 languages and obeys translation instructions, as a 1.8B model in GGUF format for llama.cpp. For developers who want a small local tran…

Qwen2.5-0.5B-Instruct

Qwen · Kit

Answers chat prompts as the smallest instruction-tuned Qwen2.5 model, at about 0.5B parameters. For developers who want a light local model for chat, structure…

GLM-5.3-Flash EXL3 3.05bpw

albucino · Kit

Runs GLM-5.3-Flash locally on two RTX 3090 cards with 128 GB of RAM and a 262,144-token context, using a verified 3.05 bpw EXL3 quantization. For people hostin…

Strata-Sage-A1.5-GGUF

ykarout · Kit

A Q4_K_M GGUF of the 35B Sage-A1.5 model made for the Strata inference engine, fitting a full 262K context on a 16 GB graphics card plus 64 GB of RAM. For peop…

Granite Speech 5.0 TurboCTC 470M GGUF

vladers · Kit

Converts speech to text in seven languages, as quantized GGUF versions of IBM's Granite Speech 5.0 TurboCTC 470M, built for transcribe.cpp. For developers addi…

Unity Coder 7B

vishnuOI · Kit

Answers Unity game development questions and writes C# scripts, XR code and editor tools, as a fine-tune of Qwen2.5-Coder-7B-Instruct. For Unity developers who…

Z-Image-Turbo-GGUF by unsloth

unsloth · Kit

Unsloth's GGUF files of Z-Image-Turbo, a fast distilled text-to-image model that the authors say fits on a 16 GB consumer GPU. For people who generate images l…

Muse Glimmer 30B GGUF

unsloth · Kit

Runs a 30B agent model locally that reads text and images, calls tools and retries failed calls, from Unsloth's GGUF files. For developers building local agent…

gemma-4-31B-it-qat-GGUF

unsloth · Kit

Runs Google's Gemma 4 31B instruction model from Unsloth's 4-bit QAT GGUF files, with an included drafter for faster speculative decoding in llama.cpp. For peo…

faster-whisper-small

Systran · Kit

Whisper small converted to the CTranslate2 format so faster-whisper can transcribe audio with it. For developers who want local speech-to-text in Python.

Flint NVFP4 GGUF

RecursiveSI · Kit

A 4-bit NVFP4 copy of the Recursive Flint text model as one GGUF file, built for NVIDIA GPUs through llama.cpp. For developers running a large local model with…

Qwen3-1.7B-GGUF

Qwen · Kit

Gives you the small Qwen3 1.7B chat model as a q8_0 GGUF file for llama.cpp, with a switch between thinking and non-thinking replies. For people who want a lig…

Xiaomi-OCR-0-GGUF

prithivMLmods · Kit

Provides GGUF files of Xiaomi-OCR-0, a compact 0.8B vision-language model for reading documents and text in images, in sizes from about 466 MB to 1.52 GB. For…

Bonsai-1.7B-GGUF

prism-ml · Kit

Generates text with a 1.7B language model packed to 1 bit per weight, about 0.24 GB, for llama.cpp on CUDA, Metal and CPU. For developers who need a tiny local…

Laguna XS 2.1

poolside · Kit

Writes code and works through long coding tasks with tool calls, using a 33B mixture-of-experts model that activates 3B parameters per token. For developers wh…

Ornith-1.0-9B-GGUF

ornith-ai · Kit

GGUF copy of a 9B open-source coding-agent model, trained with reinforcement learning to write solutions and the scaffolding around them. Built for single-GPU…

MOSS-TTS-Nano

OpenMOSS-Team · Kit

Turns text into speech with a tiny 0.1B-parameter model that can run on a CPU, supports voice cloning and covers 20 languages. It suits developers who add spee…

MiniCPM-V-4.7-1B-gguf

openbmb · Kit

Runs a 1B vision-language model through llama.cpp, answering text prompts about images. GGUF files in many quant sizes, for developers and hobbyists who want a…

Qwen3.8-27B-CodeForge-3xMerge i1 GGUF

mradermacher · Kit

Importance-matrix GGUF quants of the Qwen3.8-27B-CodeForge-3xMerge model, from about 11 GB to 22.5 GB, for local use. For people running 27B models on their ow…

Qwen3.6-35B-A3B-8bit (MLX)

mlx-community · Kit

8-bit MLX conversion of Qwen3.6-35B-A3B that reads text and images and answers in text, run with the mlx-vlm tool. For developers who want to run a large visio…

Qwen3.5-9B-OptiQ-4bit

mlx-community · Kit

A 4-bit mixed-precision MLX version of Qwen3.5-9B for local text generation on Apple Silicon, with a bundled multi-token prediction head. For Mac users who run…

Tess-4.5-27B GGUF

migtissera · Kit

GGUF builds of Tess-4.5, a 27B open-weights coding and agent model, for llama.cpp, with a vision projector and optional draft heads for faster generation. They…

GLM-5.3-Flash EXL3 3.5bpw

Mia-AiLab · Kit

Quantized copy of GLM-5.3-Flash in EXL3 format, 156 GB, with narrower routed experts, about 11 percent smaller than the same lab's 4-bit version. For people ru…

Qwen3.6-35B-A3B lododo-Distill-v1.0 (GGUF)

lododoai · Kit

Runs as a local text model, a Qwen3.6-35B-A3B fine-tune trained on data written by Qwen3.8-27B and packed as one GGUF file for llama.cpp. For people who run mo…

Slonik-27B-oQ8-mtp

kakoka · Kit

Helps write and change PostgreSQL source code with a 27B coding model, 8-bit quantized to run locally on Apple Silicon Macs through oMLX. For PostgreSQL develo…

Qwen3.8-27B-SLQ-GGUF

kaitchup · Kit

Compresses Qwen3.8-27B into three GGUF files with different size and fidelity levels, using a custom statistically lossless quantization. For people who run th…

Qwen3.8-27B-oQ6e-mtp

Jundot · Kit

A mixed-precision MLX copy of Qwen3.8-27B at about 6.9 bits per weight, with the vision encoder and multi-token prediction head included, for running locally o…

Qwen3.6-35B-A3B-oQ6e-mtp

Jundot · Kit

A mixed-precision MLX copy of Qwen3.6-35B-A3B at about 6.8 bits per weight, with the vision encoder and multi-token prediction head included, for running local…