Kits of AI agent skills, rules and prompts

Nanbeige4.3-33B-GGUF-UltraOptimised-Curated-Protium

SolsticeAI · Kit

Offers GGUF quantizations of the 33.1B Nanbeige4.3 model for llama.cpp and Ollama, with a reasoning protocol and up to 524,288 tokens of context. For developer…

Qwen2.5-1.5B-Instruct-GGUF

Qwen · Kit

Gives you the small Qwen2.5 1.5B chat model as GGUF files in eight quantization sizes, for running with llama.cpp on a laptop or modest GPU. For people who wan…

Ornith-1.5-35B-A3B-GSQ-RCO-GGUF

pfeifferj · Kit

Shrinks the Ornith-1.5-35B-A3B text model to 3-bit and 3.5-bit GGUF files, about 13 and 15 GB instead of 69 GB, for people who run local models with llama.cpp.

ttf-Qwen3.8-Flash-Next-GGUF

oguzeldereli · Kit

Runs Qwen3.8-Flash-Next, a 180B mixture-of-experts model squeezed to ternary weights, from one 40.4 GB GGUF file that is 4.6 times smaller than the FP8 release…

Hermes-3-Llama-3.1-8B-GGUF

NousResearch · Kit

Runs Hermes 3, an 8B general-purpose chat model from NousResearch, as a quantized GGUF file for llama.cpp. Suits people who want a local assistant with functio…

Hermes 3 Llama-3.1 8B

NousResearch · Kit

An 8B general-purpose chat model from Nous Research, built on Llama 3.1, with function calling, structured output, role play and code help. It suits developers…

Qwen3.8-27B-GGUF by bartowski

bartowski · Kit

A set of GGUF quantizations of Qwen3.8-27B by bartowski, from Q8_0 down to 3-bit, made with an importance matrix. For people running a 27B vision-language mode…

Jackrong_Qwopus3.8-27B-Coder-Flash-GGUF

bartowski · Kit

GGUF quantizations of Jackrong's Qwopus3.8-27B-Coder-Flash, made by bartowski with an importance matrix, in sizes from 17 GB to 55 GB. For running a 27B model…

Qwen3.5-9B-MTP-GGUF

unsloth · Kit

GGUF copies of Qwen3.5 9B that support multi-token-prediction speculative decoding in llama.cpp for faster generation. For people running the model locally who…

Qwen3.8-27B-exl3

turboderp · Kit

EXL3 quantized copies of Qwen3.8-27B in many bits-per-weight sizes, from 1.40 to 6.00. For people running the 27B model locally with ExLlamaV3 on limited GPU m…

Bonsai-27B-gguf

prism-ml · Kit

Runs a 27B-class reasoning model as a 1-bit GGUF file of about 3.9 GB for llama.cpp, so it fits a laptop or one GPU. For people who want local reasoning on eve…

DeepSeek-V4.1-Flash-1017 EXL3 EAQ v1 2.9 bpw

Mia-AiLab · Kit

A 2.9 bits-per-weight EXL3 quantization of DeepSeek-V4.1-Flash-1017 that reads text and images. It cuts the model to about 210 GB for exllamav3 runtimes, and t…

Qwen3.8-27B-GGUF by lmstudio-community

lmstudio-community · Kit

A GGUF quantization of Qwen's Qwen3.8-27B made by the LM Studio team with llama.cpp, for people who run a 27B model on their own computer.

Raon-1 mini (GGUF)

KRAFTON · Kit

Runs a 28.8B mixture-of-experts model tuned for Korean chat, reasoning and tool-using agents in llama.cpp. GGUF copy of Raon-1 mini preview for people who run…

Sage-A1.5 GGUF (Q4_K_M)

InternScience · Kit

Runs Sage-A1.5, a 35B mixture-of-experts agentic model for long scientific tasks, as a 4-bit GGUF file. It can split work across subagents and check its own pr…

Qwen3.8-2B-Distill-GGUF

empero-ai · Kit

Runs a small 2B reasoning model on phones, laptops and single-board computers, as GGUF files in five quant levels. A distillation of a large Qwen3.8 model, pac…

Nanbeige_Nanbeige4.3-33B-GGUF

bartowski · Kit

GGUF quantizations of Nanbeige4.3-33B, made by bartowski with an importance matrix, from about 21 GB to 66 GB. For running a 33B English and Chinese text model…

TinyLlama-1.1B-Chat-v1.0

TinyLlama · Kit

Chats in plain text as a small 1.1B language model that runs with little memory. For developers and researchers who want a compact chat model built on a Llama-…

Llama-V-JEPA-LM-Qwen3-4B

kkt94 · Kit

Answers questions about video clips with a 5.1B model that joins a frozen V-JEPA 2.1 video encoder to Qwen3-4B-Instruct-2507, for people who need video underst…

Llama-V-JEPA-LM-Qwen3-1.7B

kkt94 · Kit

Answers questions about video clips with a 2B model that joins a frozen V-JEPA 2.1 video encoder to Qwen3-1.7B, for people who need video understanding on one…

Llama-V-JEPA-LM-Llama3.2-3B

kkt94 · Kit

Answers questions about video clips with a 4.2B model that joins a frozen V-JEPA 2.1 video encoder to Llama-3.2-3B-Instruct, for people who need video understa…

Llama-V-JEPA-LM-Llama3.2-1B

kkt94 · Kit

Answers questions about video clips with a small 1.5B model that joins a frozen V-JEPA 2.1 video encoder to Llama-3.2-1B-Instruct, for people who need video un…

Qwen3.5-0.8B Astra Weight Edit

JonathanColetti · Kit

Fixes the repeat loops that Qwen3.5-0.8B falls into in thinking mode by editing two weight tensors directly, with no training. A small image-text model for Tra…

Qwen3.8-27B-GGUF by ggml-org

ggml-org · Kit

Runs Qwen3.8-27B, a 26.9B model that takes images and text and replies in text, as a GGUF file for local use through the llama tools. Made for people who want…

Qwen3.8-4B-Distill-GGUF

empero-ai · Kit

Runs a 4B reasoning model on a laptop or a mid-range graphics card, as GGUF files in five quant levels. A distillation of a large Qwen3.8 model, packaged by Em…

gemma-4-12B-it-qat-GGUF

unsloth · Kit

Gemma 4 12B in GGUF form, trained with quantization-aware training so a 4-bit copy keeps near-bfloat16 quality. For people running Gemma locally with llama.cpp…

Bielik-11B-v3.1-Instruct GGUF

speakleash · Kit

Chat model that answers in Polish, English and six other languages, packed as GGUF files in five sizes for llama.cpp or Ollama. For people who want an instruct…

Llama-V-JEPA-LM-Llama3.1-8B

kkt94 · Kit

Answers questions about video clips by joining a frozen V-JEPA 2.1 video encoder to Llama-3.1-8B-Instruct, made for people working on video understanding.

Qwen3-8B-GGUF

Qwen · Kit

Runs Qwen3-8B as quantized GGUF files in llama.cpp or Ollama, with a thinking mode for math, code and logic and a plain mode for chat. For people who want a lo…

Llama-V-JEPA-LM-Qwen3-8B

kkt94 · Kit

Answers questions about video clips with a 9.2B model that joins a frozen V-JEPA 2.1 video encoder to Qwen3-8B, for people who need video understanding on a GP…

Qwen3.8-9B-Distill-GGUF

empero-ai · Kit

GGUF quantizations of Empero's Qwen3.8-9B, a reasoning model distilled from a larger Qwen3.8 into the Qwen3.5-9B design, for llama.cpp, Ollama, LM Studio and s…

ZONOS3-Mini GGUF

AtomicChat · Kit

Packs the ZONOS3-Mini text-to-speech model as GGUF files for llama.cpp, with 27 built-in voices and six backbone sizes from 0.41 to 1.61 GB. For developers run…

Qwen3.8-35B-A3B-Distill-GGUF

empero-ai · Kit

Runs a 35B Mixture-of-Experts model with about 3B active parameters per token from GGUF files in ten sizes, plus a vision projector. For llama.cpp, Ollama, LM…

Qwen3.6-35B-A3B-MTP-GGUF

unsloth · Kit

Runs Qwen3.6-35B-A3B locally from Unsloth's GGUF files with multi-token prediction for faster decoding in llama.cpp. Suits developers who want a local agentic…

Qwen2.5-Coder-7B-Instruct-GGUF

Qwen · Kit

Runs a 7B instruction-tuned coding model from Qwen on your own machine, packed as GGUF files in eight quantization levels. Made for developers who want code he…

Thinklite-27B-GGUF

Sparset · Kit

A 4-bit GGUF copy of Thinklite-27B for llama.cpp that uses less reasoning per answer than its base model, for people running a 27B text model locally.

S5-nano-GGUF

maritaca-ai · Kit

Runs Maritaca AI's S5-nano, a 4B model tuned for Brazilian Portuguese with function calling and a think mode, from GGUF files of 2.8 to 8.7 GB for llama.cpp an…

MNN-Pocket-0.3B-GGUF

taobao-mnn · Kit

Runs a compact 0.3B Chinese and English language model from GGUF files of 192 to 726 MB, made for phones, laptops and other on-device use with llama.cpp, LM St…

BotPsy-0.8B-GGUFs

qvac · Kit

GGUF copies of the 0.8B BotPsy tool-calling model in BF16, Q8_0 and Q4_K_M, for running agent and function-calling work fully on your own device with llama.cpp.

Raon-1 nano (GGUF)

KRAFTON · Kit

Packages the Raon-1 nano language model as GGUF files for llama.cpp, so developers can run a Korean and English chat model on their own computer. Four quant ty…

Ripple-65B-Preview-GGUF

AtomicChat · Kit

GGUF quantized files of the 65B Ripple Preview agentic-coding model, for running locally with llama.cpp. For people who run large open models on their own hard…

Agents Course Notebooks

agents-course · Kit

Collects the notebooks of the Hugging Face Agents Course, covering a dummy agent library, smolagents, LlamaIndex, LangGraph and two bonus units. For learners b…

Qwen3.8-27B GGUF (ShapeLearn Quantized)

byteshape · Kit

Runs Qwen3.8-27B as GGUF files quantized by ByteShape's ShapeLearn, in five GPU-sized options with vision input and MTP speculative decoding in llama.cpp. For…

Qwen3.8-27B-DSpine-b16-GGUF

aj9o9 · Kit

A GGUF draft model that speeds up Qwen3.8-27B in llama.cpp through speculative decoding, reaching about 125 tokens per second on code and math on one RTX 3090.…

Qwen3.8-27B-GSQ-RCO-GGUF

ISTA-DASLab · Kit

ISTA-DASLab's GGUF versions of Qwen3.8-27B in four sizes, each tensor quantized at its own precision, with a vision projector for images. Suits people who run…

KVPress Leaderboard

nvidia · Kit

Shows a leaderboard that benchmarks KV cache compression methods for language models, using Llama-3.1-8B-Instruct and Qwen3-8B. It suits researchers and engine…

VideoLLaMA2

lixin4ever · Kit

A chat app for understanding media such as video, built on the VideoLLaMA2 models. Runs in the browser as a Gradio app on ZeroGPU, for people who want to ask q…

Llama logo

ggml-org · Kit

Shows how the Llama icon is built, from a plus sign and an L to the finished mark, as a page you can explore. For designers and developers who use or study the…

Joy Caption Pre Alpha

fancyfeast · Kit

An early demo that pairs a SigLIP vision model with Llama 3.1 8B, apparently to write captions for images. A Gradio app on Hugging Face, marked pre-alpha by it…

PROMPT++

baconnier · Kit

Refines the prompts you write for AI models, using a metaprompt router and a refiner that call open models such as Zephyr and Llama. For anyone who wants clear…