AI projects from Hugging Face

Qwen3.5-4B-3D-Coder-GGUF

prithivMLmods · Kit

Writes code and builds interactive 3D scenes as self-contained Three.js pages, using GGUF copies of an early-preview Qwen3.5-4B fine-tune. For developers who p…

Qwen2.5-Coder-1.5B Q8_0 GGUF

ggml-org · Kit

Runs Qwen2.5-Coder 1.5B on your own machine as a Q8_0 GGUF file through llama.cpp, from the command line or as a local server. It suits developers who want a s…

BaronLLM Offensive Security LLM Q6_K GGUF

AlicanKiraz0 · Kit

Answers security questions and helps plan authorized red-team exercises, as a Q6_K GGUF fine-tune of Llama 3.1 8B. For security researchers working on systems…

Xiaomi-OCR-0-GGUF

prithivMLmods · Kit

Provides GGUF files of Xiaomi-OCR-0, a compact 0.8B vision-language model for reading documents and text in images, in sizes from about 466 MB to 1.52 GB. For…

Bonsai-1.7B-GGUF

prism-ml · Kit

Generates text with a 1.7B language model packed to 1 bit per weight, about 0.24 GB, for llama.cpp on CUDA, Metal and CPU. For developers who need a tiny local…

Qwen3-Reranker-0.6B-Q8_0-GGUF

ggml-org · Kit

Ranks passages by relevance to a query, as an 8-bit GGUF copy of the Qwen3 0.6B reranker made with llama.cpp. For developers who want a small local reranker fo…

Spark-X2.6-1.7B-DSpark-GGUF

XHToken · Kit

A small draft model that speeds up Spark-X2.6-1.7B through speculative decoding, guessing up to seven tokens per step. For people who run that model locally on…

Spark-X2.6-4B-DSpark-GGUF

XHToken · Kit

Speeds up text generation for Spark-X2.6-4B as a small draft model for speculative decoding, in GGUF format. Meant for people running that model locally with l…

Qwen3.5-0.8B-weight-space-programming-GGUF

prithivMLmods · Kit

GGUF copies of a small Qwen3.5 0.8B model whose weights were edited directly to reduce reasoning loops. For people who want to run it locally in several quant…

Bonsai-27B-gguf

prism-ml · Kit

Runs a 27B-class reasoning model as a 1-bit GGUF file of about 3.9 GB for llama.cpp, so it fits a laptop or one GPU. For people who want local reasoning on eve…

Qwen3.5-4B-3D-Coder-MTP-Repacked

prithivMLmods · Kit

A repacked copy of ccore's Qwen3.5-4B-3D-Coder, a small model tuned to write coding answers and Three.js 3D scenes, with GGUF files that support multi-token pr…

Qwen3.8-27B-QSA-GGUF

higa2515 · Kit

Runs Qwen3.8-27B with sparse attention from GGUF files in Q8_0 and Unsloth Q4, Q5 and Q6 mixes, with text, image and video input. For Linux users with NVIDIA G…

MNN-Pocket-0.3B-GGUF

taobao-mnn · Kit

Runs a compact 0.3B Chinese and English language model from GGUF files of 192 to 726 MB, made for phones, laptops and other on-device use with llama.cpp, LM St…

LLM VRAM Calculator

donaldJJ · Kit

Estimates how much GPU memory a Hugging Face model needs at any quantization and context length, split into weights, KV cache and overhead, and shows which GPU…