Spark-X2.6-1.7B-DSpark-GGUF
XHToken · Kit
A small draft model that speeds up Spark-X2.6-1.7B through speculative decoding, guessing up to seven tokens per step. For people who run that model locally on…
XHToken · Kit
A small draft model that speeds up Spark-X2.6-1.7B through speculative decoding, guessing up to seven tokens per step. For people who run that model locally on…
unsloth · Kit
Chats, summarizes and answers questions in text on a laptop, as Unsloth's GGUF copy of Meta's small Llama 3.2 1B Instruct in precisions from 16-bit to 2-bit. F…
unsloth · Kit
Generates text in Chinese and English from GGUF files of the 9.4B GLM-4-9B-0414 model, for people who want to run a GLM model on their own computer.
unsloth · Kit
Unsloth's GGUF files of Google DeepMind's Gemma 4 E2B instruction-tuned model, which takes text and images and writes text, with a 128K context. For people who…
unsloth · Kit
Answers questions about text and images on your own computer, as a GGUF copy of Google's Gemma 3 4B instruction model packaged by Unsloth. For developers and u…
thinkingmachines · Kit
The NVFP4 copy of Inkling-Small, a multimodal mixture-of-experts model that takes text, images and audio and writes text. For developers building agents, codin…
ReadyArt · Kit
Runs a 30.7B-parameter Gemma-based text model locally in GGUF format, packaged by ReadyArt from its gemma-4-31B-it-scotoma-2 model. Suits people who want that…
Qwen · Kit
Gives researchers a pre-trained-only vision-language base model for fine-tuning and in-context learning experiments, not for direct chat. Suits developers who…
Qwen · Kit
A 4B chat model in GGUF format that runs locally in llama.cpp or ollama, with a thinking mode for reasoning and a plain mode for quick replies. Suits developer…
Qwen · Kit
Reasons through hard problems in a thinking mode and answers everyday chat in a faster non-thinking mode, as a 14.8B-parameter open model. Suits developers who…
Qwen · Kit
Writes, explains and fixes code as the largest instruction-tuned model in the Qwen2.5-Coder family, at 32B parameters. For developers who run a strong open cod…
Qwen · Kit
Gives you the Qwen2.5-Coder 14B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp. For developers who want a stronger lo…
Qwen · Kit
Gives you the small Qwen2.5-Coder 1.5B instruct model as GGUF files in eight quantization sizes, for coding help with llama.cpp on a laptop. For developers who…
ornith-ai · Kit
Handles coding and terminal tasks as a 9B dense language model sized for a single GPU. For developers who want a small open model for software work, with a mob…
ornith-ai · Kit
Gives you an NVFP4 quantized copy of Ornith-1.5-122B, a 122B mixture-of-experts text model meant for single-GPU use and strong in coding tests. For developers…
openbmb · Kit
Reads single images, several images and video and answers in text, with 1.3B parameters sized for phones and other edge devices. For developers who want a smal…
NaiveAI · Kit
Open-weight mixture-of-experts model with 309B parameters, 15.5B active and a native 1M token context, built for coding and AI research. For teams running larg…
mradermacher · Kit
Static GGUF quantizations of ccore/Qwen3.5-4B-GLB-3D-Coder, a 4.2B model, in sizes from 2.0 GB to 8.5 GB, plus two small multi-modal supplement files. Made by…
mradermacher · Kit
GGUF quantized files of BAAI's AREX-2, a 26.9B model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit people who run a large model local…
JetBrains · Kit
Runs JetBrains' 12B reasoning model locally in llama.cpp, Ollama or LM Studio, with five GGUF sizes to pick from. For developers who want a thinking model with…