Qwen3.5-4B-GGUF
unsloth · Kit
Unsloth's GGUF quantized copy of Qwen3.5-4B, a small model that reads images and text and answers in text, for people running models locally.
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
unsloth · Kit
Unsloth's GGUF quantized copy of Qwen3.5-4B, a small model that reads images and text and answers in text, for people running models locally.
unsloth · Kit
Runs Unsloth's GGUF copy of the GLM-5.3-Flash text model on your own hardware, a large open model its authors aim at coding and agent work. For people with ple…
unsloth · Kit
Runs Qwen3.6-35B-A3B locally from Unsloth's GGUF files with multi-token prediction for faster decoding in llama.cpp. Suits developers who want a local agentic…
unsloth · Kit
Runs Flint, a 39.8B mixture-of-experts model for coding agents that uses about 2.5B parameters per token, from Unsloth GGUF files. For developers who run codin…
Jackrong · Kit
Helps with coding and tool-using agent work as a GGUF fine-tune of Qwen3.8-27B, trained on about 200,000 code, agent and reasoning examples. For developers who…
169Pi · Kit
Runs Alpie Seed 9B, an image-and-text model from 169Pi AI, on your own machine through GGUF files in three bit depths. Suits developers who want local vision-l…
unsloth · Kit
Unsloth's GGUF quantized copy of Qwen3.5-9B, a mid-size model that reads images and text and answers in text, for people running models locally.
Qwen · Kit
Runs a 7B instruction-tuned coding model from Qwen on your own machine, packed as GGUF files in eight quantization levels. Made for developers who want code he…
ccore · Kit
Writes a complete Three.js page for a game asset you describe, with a 3D preview and an Export GLB button. A fine-tuned Qwen3-1.7B in GGUF that runs on modest…
Sparset · Kit
A 4-bit GGUF copy of Thinklite-27B for llama.cpp that uses less reasoning per answer than its base model, for people running a 27B text model locally.
maritaca-ai · Kit
Runs Maritaca AI's S5-nano, a 4B model tuned for Brazilian Portuguese with function calling and a think mode, from GGUF files of 2.8 to 8.7 GB for llama.cpp an…
higa2515 · Kit
Runs Qwen3.8-27B with sparse attention from GGUF files in Q8_0 and Unsloth Q4, Q5 and Q6 mixes, with text, image and video input. For Linux users with NVIDIA G…
AtomicChat · Kit
Runs Nous Research's Arete 27B, a Qwen3.8-27B fine-tune that reads text and images, from GGUF files in six sizes with measured quality losses. For people runni…
XHToken · Kit
A compact 4B language model in GGUF form for on-device use, tuned for coding, agents and long context, with three thinking levels from none to high. Works in E…
taobao-mnn · Kit
Runs a compact 0.3B Chinese and English language model from GGUF files of 192 to 726 MB, made for phones, laptops and other on-device use with llama.cpp, LM St…
ornith-ai · Kit
Runs a 35B mixture-of-experts text model tuned for coding and agent work, using only about 3B parameters per token. This repository holds its GGUF files for lo…
unsloth · Kit
Runs Qwen3.6-35B-A3B, a mixture-of-experts model that reads images and text and uses about 3B parameters per token, from Unsloth GGUF files. For developers who…
qvac · Kit
GGUF copies of the 0.8B BotPsy tool-calling model in BF16, Q8_0 and Q4_K_M, for running agent and function-calling work fully on your own device with llama.cpp.
peculiar-ragdoll · Kit
Runs a 4B coding model with long context on a graphics card with 6 GB of memory. These GGUF quants of Spark-X2.6-4B come in three sizes and use a coding-weight…
DavidAU · Kit
Runs Qwen3.8-27B in GGUF form with a set of reasoning and instruct modes you switch from your prompt. For people who run local models and like to tune how the…