Sage-A1.5 GGUF (Q4_K_M)
InternScience · Kit
Runs Sage-A1.5, a 35B mixture-of-experts agentic model for long scientific tasks, as a 4-bit GGUF file. It can split work across subagents and check its own pr…
InternScience · Kit
Runs Sage-A1.5, a 35B mixture-of-experts agentic model for long scientific tasks, as a 4-bit GGUF file. It can split work across subagents and check its own pr…
google · Kit
Runs Google's Gemma 4 12B instruction-tuned model in a 4-bit GGUF file made with quantization-aware training. Reads text and images, and suits laptops and cons…
empero-ai · Kit
Runs a small 2B reasoning model on phones, laptops and single-board computers, as GGUF files in five quant levels. A distillation of a large Qwen3.8 model, pac…
bartowski · Kit
GGUF quantizations of Nanbeige4.3-33B, made by bartowski with an importance matrix, from about 21 GB to 66 GB. For running a 33B English and Chinese text model…
unsloth · Kit
Unsloth's GGUF files of Qwen2.5-VL-7B-Instruct, a vision-language model that reads images, charts, documents and long videos and can output coordinates and str…
unsloth · Kit
A 4-bit GGUF copy of Google's Gemma 4 E4B instruction model, packaged by Unsloth for running on your own machine. It reads text and images and answers in text.
unsloth · Kit
Unsloth's GGUF quantized copy of Google's instruction-tuned Gemma 4 12B, a model that takes text, images, audio and video and writes text, for running locally.
unsloth · Kit
Turns text into 768-dimensional vectors for on-device search, retrieval and clustering. The base model also covers images, video and audio. Packaged as GGUF by…
ggml-org · Kit
Runs Qwen3.8-27B, a 26.9B model that takes images and text and replies in text, as a GGUF file for local use through the llama tools. Made for people who want…
empero-ai · Kit
Runs a 4B reasoning model on a laptop or a mid-range graphics card, as GGUF files in five quant levels. A distillation of a large Qwen3.8 model, packaged by Em…
XHToken · Kit
Runs a small 1.7B on-device language model from XHToken as 4-bit GGUF files, for chat, coding and agent tasks in English and Chinese, with adjustable thinking…
unsloth · Kit
Gemma 4 12B in GGUF form, trained with quantization-aware training so a 4-bit copy keeps near-bfloat16 quality. For people running Gemma locally with llama.cpp…
speakleash · Kit
Chat model that answers in Polish, English and six other languages, packed as GGUF files in five sizes for llama.cpp or Ollama. For people who want an instruct…
prithivMLmods · Kit
A repacked copy of ccore's Qwen3.5-4B-3D-Coder, a small model tuned to write coding answers and Three.js 3D scenes, with GGUF files that support multi-token pr…
lapadatbogdan · Kit
Runs a pruned GLM-5.3-Flash coding and agent model on a home PC, as GGUF files in five quant sizes. It keeps 152 of 288 experts per layer, cutting a 321B model…
unsloth · Kit
Runs Google's Gemma 4 31B instruction-tuned model locally from Unsloth's GGUF files, with text and image input and a long context. Suits developers who want a…
TimeLordRaps · Kit
An 8-bit GGUF build of SperiD Labs' Idol that turns one image into a 3D Gaussian point cloud and a mesh, run locally with idol.cpp. For developers working on i…
Qwen · Kit
Runs Qwen3-8B as quantized GGUF files in llama.cpp or Ollama, with a thinking mode for math, code and logic and a plain mode for chat. For people who want a lo…
peasantsmith · Kit
Five GGUF compressions of GLM-5.3-Flash, a 321B mixture-of-experts model, sized from 73.4 GB to 156.3 GB for Project Maya, which spreads the model across GPU,…
empero-ai · Kit
GGUF quantizations of Empero's Qwen3.8-9B, a reasoning model distilled from a larger Qwen3.8 into the Qwen3.5-9B design, for llama.cpp, Ollama, LM Studio and s…
AtomicChat · Kit
Packs the ZONOS3-Mini text-to-speech model as GGUF files for llama.cpp, with 27 built-in voices and six backbone sizes from 0.41 to 1.61 GB. For developers run…
yuxinlu1 · Kit
A GGUF fine-tune of Google's Gemma 4 12B instruction model for coding and tool-using agent work, sized to run offline on a machine with about 4.5 GB of free me…
empero-ai · Kit
Runs a 35B Mixture-of-Experts model with about 3B active parameters per token from GGUF files in ten sizes, plus a vision projector. For llama.cpp, Ollama, LM…
unsloth · Kit
Unsloth's GGUF quantized copy of Qwen3.5-4B, a small model that reads images and text and answers in text, for people running models locally.
unsloth · Kit
Runs Unsloth's GGUF copy of the GLM-5.3-Flash text model on your own hardware, a large open model its authors aim at coding and agent work. For people with ple…
unsloth · Kit
Runs Qwen3.6-35B-A3B locally from Unsloth's GGUF files with multi-token prediction for faster decoding in llama.cpp. Suits developers who want a local agentic…
unsloth · Kit
Runs Flint, a 39.8B mixture-of-experts model for coding agents that uses about 2.5B parameters per token, from Unsloth GGUF files. For developers who run codin…
Jackrong · Kit
Helps with coding and tool-using agent work as a GGUF fine-tune of Qwen3.8-27B, trained on about 200,000 code, agent and reasoning examples. For developers who…
169Pi · Kit
Runs Alpie Seed 9B, an image-and-text model from 169Pi AI, on your own machine through GGUF files in three bit depths. Suits developers who want local vision-l…
unsloth · Kit
Unsloth's GGUF quantized copy of Qwen3.5-9B, a mid-size model that reads images and text and answers in text, for people running models locally.
Qwen · Kit
Runs a 7B instruction-tuned coding model from Qwen on your own machine, packed as GGUF files in eight quantization levels. Made for developers who want code he…
ccore · Kit
Writes a complete Three.js page for a game asset you describe, with a 3D preview and an Export GLB button. A fine-tuned Qwen3-1.7B in GGUF that runs on modest…
Sparset · Kit
A 4-bit GGUF copy of Thinklite-27B for llama.cpp that uses less reasoning per answer than its base model, for people running a 27B text model locally.
maritaca-ai · Kit
Runs Maritaca AI's S5-nano, a 4B model tuned for Brazilian Portuguese with function calling and a think mode, from GGUF files of 2.8 to 8.7 GB for llama.cpp an…
higa2515 · Kit
Runs Qwen3.8-27B with sparse attention from GGUF files in Q8_0 and Unsloth Q4, Q5 and Q6 mixes, with text, image and video input. For Linux users with NVIDIA G…
AtomicChat · Kit
Runs Nous Research's Arete 27B, a Qwen3.8-27B fine-tune that reads text and images, from GGUF files in six sizes with measured quality losses. For people runni…
XHToken · Kit
A compact 4B language model in GGUF form for on-device use, tuned for coding, agents and long context, with three thinking levels from none to high. Works in E…
taobao-mnn · Kit
Runs a compact 0.3B Chinese and English language model from GGUF files of 192 to 726 MB, made for phones, laptops and other on-device use with llama.cpp, LM St…
ornith-ai · Kit
Runs a 35B mixture-of-experts text model tuned for coding and agent work, using only about 3B parameters per token. This repository holds its GGUF files for lo…
unsloth · Kit
Runs Qwen3.6-35B-A3B, a mixture-of-experts model that reads images and text and uses about 3B parameters per token, from Unsloth GGUF files. For developers who…
qvac · Kit
GGUF copies of the 0.8B BotPsy tool-calling model in BF16, Q8_0 and Q4_K_M, for running agent and function-calling work fully on your own device with llama.cpp.
peculiar-ragdoll · Kit
Runs a 4B coding model with long context on a graphics card with 6 GB of memory. These GGUF quants of Spark-X2.6-4B come in three sizes and use a coding-weight…
DavidAU · Kit
Runs Qwen3.8-27B in GGUF form with a set of reasoning and instruct modes you switch from your prompt. For people who run local models and like to tune how the…
KRAFTON · Kit
Packages the Raon-1 nano language model as GGUF files for llama.cpp, so developers can run a Korean and English chat model on their own computer. Four quant ty…
AtomicChat · Kit
GGUF quantized files of the 65B Ripple Preview agentic-coding model, for running locally with llama.cpp. For people who run large open models on their own hard…
169Pi · Kit
Reads text, images and video and handles reasoning and coding with a 9B open-weight model built on Qwen3.5-9B, with GGUF builds for light hardware. For develop…
byteshape · Kit
Runs Qwen3.8-27B as GGUF files quantized by ByteShape's ShapeLearn, in five GPU-sized options with vision input and MTP speculative decoding in llama.cpp. For…
ISTA-DASLab · Kit
GGUF versions of DeepSeek-V4.1-Flash-1017 at three small sizes, with each tensor quantized at its own precision. For people running a huge mixture-of-experts m…
unsloth · Kit
Unsloth's GGUF quantizations of DeepSeek-V4.1-Flash-1017, a huge image-and-text model, for running locally on a machine with 128 GB or more of RAM. For people…
ornith-ai · Kit
Offers GGUF files of Ornith-1.5-9B, a 9B dense model trained through a self-improvement loop, for single-GPU use. Aimed at developers who want a small model wi…