Qwen2.5-Coder-7B-Instruct-GGUF
Qwen · Kit
Runs a 7B instruction-tuned coding model from Qwen on your own machine, packed as GGUF files in eight quantization levels. Made for developers who want code he…
Qwen · Kit
Runs a 7B instruction-tuned coding model from Qwen on your own machine, packed as GGUF files in eight quantization levels. Made for developers who want code he…
openbmb · Kit
Generates text with a dense 2B-class model made for on-device and local use, covering coding, math, long context, tool use and agent tasks in English and Chine…
Sparset · Kit
A 4-bit GGUF copy of Thinklite-27B for llama.cpp that uses less reasoning per answer than its base model, for people running a 27B text model locally.
maritaca-ai · Kit
Runs Maritaca AI's S5-nano, a 4B model tuned for Brazilian Portuguese with function calling and a think mode, from GGUF files of 2.8 to 8.7 GB for llama.cpp an…
taobao-mnn · Kit
Runs a compact 0.3B Chinese and English language model from GGUF files of 192 to 726 MB, made for phones, laptops and other on-device use with llama.cpp, LM St…
qvac · Kit
GGUF copies of the 0.8B BotPsy tool-calling model in BF16, Q8_0 and Q4_K_M, for running agent and function-calling work fully on your own device with llama.cpp.
KRAFTON · Kit
Packages the Raon-1 nano language model as GGUF files for llama.cpp, so developers can run a Korean and English chat model on their own computer. Four quant ty…
AtomicChat · Kit
GGUF quantized files of the 65B Ripple Preview agentic-coding model, for running locally with llama.cpp. For people who run large open models on their own hard…
agents-course · Kit
Collects the notebooks of the Hugging Face Agents Course, covering a dummy agent library, smolagents, LlamaIndex, LangGraph and two bonus units. For learners b…
byteshape · Kit
Runs Qwen3.8-27B as GGUF files quantized by ByteShape's ShapeLearn, in five GPU-sized options with vision input and MTP speculative decoding in llama.cpp. For…
Nanbeige · Kit
A 33.1B open model for agentic coding and professional cowork tasks, built as the flagship teacher of the Nanbeige4.3 series. For developers and agent builders…
aj9o9 · Kit
A GGUF draft model that speeds up Qwen3.8-27B in llama.cpp through speculative decoding, reaching about 125 tokens per second on code and math on one RTX 3090.…
ISTA-DASLab · Kit
ISTA-DASLab's GGUF versions of Qwen3.8-27B in four sizes, each tensor quantized at its own precision, with a vision projector for images. Suits people who run…
nvidia · Kit
Shows a leaderboard that benchmarks KV cache compression methods for language models, using Llama-3.1-8B-Instruct and Qwen3-8B. It suits researchers and engine…
lixin4ever · Kit
A chat app for understanding media such as video, built on the VideoLLaMA2 models. Runs in the browser as a Gradio app on ZeroGPU, for people who want to ask q…
ggml-org · Kit
Shows how the Llama icon is built, from a plus sign and an L to the finished mark, as a page you can explore. For designers and developers who use or study the…
fancyfeast · Kit
An early demo that pairs a SigLIP vision model with Llama 3.1 8B, apparently to write captions for images. A Gradio app on Hugging Face, marked pre-alpha by it…
baconnier · Kit
Refines the prompts you write for AI models, using a metaprompt router and a refiner that call open models such as Zephyr and Llama. For anyone who wants clear…
SadikNawazAI · Kit
A multilingual chat assistant that runs fully inside your browser through WebAssembly, so your messages stay on your device. Also reachable through Ollama and…