Spark-X2.6-4B GGUF
bartowski · Kit
Small English and Chinese chat model as GGUF files from full bf16 down to about 2.4 GB, for llama.cpp, with a low or high thinking setting. For developers who…
bartowski · Kit
Small English and Chinese chat model as GGUF files from full bf16 down to about 2.4 GB, for llama.cpp, with a low or high thinking setting. For developers who…
Aleph-Alpha · Kit
Reasons and calls tools in German and English, with a context window of more than a million tokens. An open 78B mixture-of-experts model from Aleph Alpha that…
XHToken · Kit
Speeds up text generation for Spark-X2.6-4B as a small draft model for speculative decoding, in GGUF format. Meant for people running that model locally with l…
XHToken · Kit
A 4.1B language model for on-device use, tuned for coding, agent tasks, long context and reasoning in English and Chinese, with three thinking levels. For deve…
Remek · Kit
Answers typed questions about a message, document or agent trace with a calibrated probability for each allowed answer, in one pass without generating text. An…
brandonmusic · Kit
A compressed copy of DeepSeek-V4.1-Flash-1017 sized for two 96 GB GPUs, with a few experts stored at higher precision. A research build for people who serve la…
XiaomiMiMo · Kit
Handles text, image, video and audio input in one model, with a 1M-token context for long repositories and agent runs. An open 311B mixture-of-experts model fr…
unsloth · Kit
Runs the Ornith-1.5-122B text model on your own machine, as GGUF files made by unsloth. A 122B mixture-of-experts model aimed at coding and agent work on a sin…
Qwen · Kit
Turns text and code in over 100 languages into vectors for search, retrieval, classification and clustering, with adjustable vector size and task instructions,…
Qwen · Kit
Works as a coding agent model with 80B total and 3B active parameters and a 256K context. For developers who run agents in CLI and IDE tools and want to host t…
Qwen · Kit
Answers chat prompts with a 4B model that skips visible thinking and reads up to 256K tokens of context. For developers who want a small open assistant for rea…
Qwen · Kit
Writes, explains and fixes code as a 7B instruction-tuned member of the Qwen2.5-Coder family. For developers who want a capable open coding model that fits on…
Qwen · Kit
Gives you the small Qwen2.5 1.5B chat model as GGUF files in eight quantization sizes, for running with llama.cpp on a laptop or modest GPU. For people who wan…
Qwen · Kit
A small 1.5B chat model from Qwen that follows instructions, writes code and math, returns structured output such as JSON and handles over 29 languages. For de…
pfeifferj · Kit
Shrinks the Ornith-1.5-35B-A3B text model to 3-bit and 3.5-bit GGUF files, about 13 and 15 GB instead of 69 GB, for people who run local models with llama.cpp.
peasantsmith · Kit
Runs a 748B DeepSeek mixture-of-experts model on a home PC through two GGUF quantizations made for Project Maya. For people with a big-RAM machine and a fast S…
PCL-RSI-lab · Kit
Fixes software bugs with a self-improving coding agent that learns reusable reasoning patterns from its own successful runs, for developers and researchers wor…
openbmb · Kit
Gives you MiniCPM5-2B, a small dense text model for English and Chinese, as GGUF files for on-device and local use. Suits people who want a compact model for c…
NousResearch · Kit
A 14B hybrid reasoning model from Nous Research, built on Qwen3-14B. It can think step by step, call tools, and return JSON that follows a schema. It uses the…
NousResearch · Kit
An 8B general-purpose chat model from Nous Research, built on Llama 3.1, with function calling, structured output, role play and code help. It suits developers…