Needle 3
Cactus-Compute · Kit
A small on-device model from Cactus Compute for tool calling, structured extraction and text embeddings, used through the cactus Python package. For developers…
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Cactus-Compute · Kit
A small on-device model from Cactus Compute for tool calling, structured extraction and text embeddings, used through the cactus Python package. For developers…
169Pi · Kit
Runs Alpie Seed 9B, an image-and-text model from 169Pi AI, on your own machine through GGUF files in three bit depths. Suits developers who want local vision-l…
unsloth · Kit
Unsloth's GGUF quantized copy of Qwen3.5-9B, a mid-size model that reads images and text and answers in text, for people running models locally.
openbmb · Kit
Generates text with a dense 2B-class model made for on-device and local use, covering coding, math, long context, tool use and agent tasks in English and Chine…
froggeric · Kit
Swaps Qwen's official chat templates for one drop-in Jinja file that fixes rendering errors, cache invalidation, wasted tokens and agent stalls. For people who…
Sparset · Kit
A 4-bit GGUF copy of Thinklite-27B for llama.cpp that uses less reasoning per answer than its base model, for people running a 27B text model locally.
qvac · Kit
A small 0.8B model for function calling and agent workflows, built on Qwen3.5-0.8B and light enough to run on a device, for developers who want a local assista…
KRAFTON · Kit
Provides Raon-1 nano as 4-bit MLX weights for Apple silicon, so developers can run a Korean and English chat model locally on a Mac. For app builders and local…
ornith-ai · Kit
Runs a 35B mixture-of-experts text model tuned for coding and agent work, using only about 3B parameters per token. This repository holds its GGUF files for lo…
google · Kit
Google's Gemma 4 12B Unified model, an open model that reads text, images, audio and video and writes text, with a 256K context and no separate encoders. For d…
unsloth · Kit
Runs Qwen3.6-35B-A3B, a mixture-of-experts model that reads images and text and uses about 3B parameters per token, from Unsloth GGUF files. For developers who…
openai · Kit
Writes, reasons and calls tools from text prompts, in an open-weight 21B model from OpenAI that runs within 16 GB of memory. For developers who want a local or…
lodestones · Kit
Cuts MOSS-Image-SFT image generation down to 8 steps with no CFG, shipped as LoRA files for ComfyUI. A work-in-progress distillation for people who generate im…
Cactus-Compute · Kit
Provides prebuilt runtime binaries that run text, speech and vision models locally on phones, laptops, servers and browsers. For developers who ship on-device…
DavidAU · Kit
Runs Qwen3.8-27B in GGUF form with a set of reasoning and instruct modes you switch from your prompt. For people who run local models and like to tune how the…
meta-models · Kit
Reads text and images and carries out agent tasks such as tool calls and multi-step reasoning on a local machine, in a 30B model distilled from Muse Spark. For…
AtomicChat · Kit
GGUF quantized files of the 65B Ripple Preview agentic-coding model, for running locally with llama.cpp. For people who run large open models on their own hard…
SyzygyResearch · Kit
Turns English text into speech on a single CPU core, using a 3.5-bit version of Gradium's Phonon 31m model that runs several times faster than real time, for d…
unsloth · Kit
Unsloth's GGUF quantizations of DeepSeek-V4.1-Flash-1017, a huge image-and-text model, for running locally on a machine with 128 GB or more of RAM. For people…
ISTA-DASLab · Kit
A coding-focused GGUF build of Qwen3.8-Flash-Next with half its experts removed, cutting 354 GB at BF16 to 58.4 GB while keeping image input. For people with l…