AI projects from Hugging Face

gemma-4-12B-it-qat-GGUF

unsloth · Kit

Gemma 4 12B in GGUF form, trained with quantization-aware training so a 4-bit copy keeps near-bfloat16 quality. For people running Gemma locally with llama.cpp…

Qwen3.8-27B-NVFP4

unsloth · Kit

A 4-bit NVFP4 copy of the Qwen3.8 27B vision-language model made by Unsloth, for serving with vLLM. For developers who want a dense model that reads images and…

halogen-qwen3.8-flash-next

peonist-ai · Kit

Holds the model weights for halogen-flash-server, an engine that runs Qwen3.8-Flash-Next on AMD Strix Halo machines, for owners of that hardware who want the m…

Qwen3.8-27B NVFP4

nvidia · Kit

NVIDIA's 4-bit NVFP4 build of Alibaba's Qwen3.8-27B, made with Model Optimizer for Blackwell GPUs, taking text, image and video in and giving text back.

Raon-1 nano (LiteRT-LM)

KRAFTON · Kit

Packs Raon-1 nano as a 4-bit LiteRT-LM bundle with a 4,096-token context, for running a Korean and English chat model on devices. Replies come without a thinki…

Thinklite-27B-GGUF

Sparset · Kit

A 4-bit GGUF copy of Thinklite-27B for llama.cpp that uses less reasoning per answer than its base model, for people running a 27B text model locally.

Raon-1 nano (MLX)

KRAFTON · Kit

Provides Raon-1 nano as 4-bit MLX weights for Apple silicon, so developers can run a Korean and English chat model locally on a Mac. For app builders and local…

Earlybird by sahilmahendrakar

sahilmahendrakar · Kit

Turns speech into text on a device and predicts each word before the speaker finishes it, scoring every word. A 16.8 MB English model for voice agents and live…

dale-0.8b-GGUF

manuelgscom · Kit

A small 4-bit GGUF model that turns a plain request in Spanish or English into one Linux bash command. It runs offline on a CPU inside the dale tool. For peopl…