Qwen3.8-27B-AWQ-INT4
cyankiwi · Kit
A 4-bit AWQ quantization of Qwen3.8-27B by cyankiwi, a 27B vision-language model with thinking control. Weights are 21.02 GB and load in Transformers, vLLM or…
cyankiwi · Kit
A 4-bit AWQ quantization of Qwen3.8-27B by cyankiwi, a 27B vision-language model with thinking control. Weights are 21.02 GB and load in Transformers, vLLM or…
agentionai · Kit
Gives shorter, more direct answers than Qwen3.8-27B by using fewer answer and thinking tokens, so replies finish sooner. A light fine-tune that drops into the…
zai-org · Kit
A 320B-parameter multimodal model with 18B active that reads text and images, with an adjustable thinking budget and a hybrid attention design for long context…
Qwen · Kit
A 4B chat model in GGUF format that runs locally in llama.cpp or ollama, with a thinking mode for reasoning and a plain mode for quick replies. Suits developer…
Qwen · Kit
Reasons through hard problems in a thinking mode and answers everyday chat in a faster non-thinking mode, as a 14.8B-parameter open model. Suits developers who…
JetBrains · Kit
Runs JetBrains' 12B reasoning model locally in llama.cpp, Ollama or LM Studio, with five GGUF sizes to pick from. For developers who want a thinking model with…
bartowski · Kit
Small English and Chinese chat model as GGUF files from full bf16 down to about 2.4 GB, for llama.cpp, with a low or high thinking setting. For developers who…
XHToken · Kit
A 4.1B language model for on-device use, tuned for coding, agent tasks, long context and reasoning in English and Chinese, with three thinking levels. For deve…
Qwen · Kit
Answers chat prompts with a 4B model that skips visible thinking and reads up to 256K tokens of context. For developers who want a small open assistant for rea…
JetBrains · Kit
A 12B mixture-of-experts thinking model with 2.5B active parameters, trained with reinforcement learning on real repositories for coding agents, math and hard…
HuggingFaceTB · Kit
Writes text and answers questions as a small 3B open model with switchable step-by-step thinking, tool calling and long context, for developers who want a comp…
google · Kit
Takes text, images and audio and writes text answers, in one 12B instruction-tuned model from Google DeepMind with a 256K-token context and configurable thinki…
XHToken · Kit
Generates text with a compact 1.7B model for on-device use, with three adjustable thinking levels. Suits developers who want coding, agent and long-context hel…
JonathanColetti · Kit
Fixes the repeat loops that Qwen3.5-0.8B falls into in thinking mode by editing two weight tensors directly, with no training. A small image-text model for Tra…
XHToken · Kit
Runs a small 1.7B on-device language model from XHToken as 4-bit GGUF files, for chat, coding and agent tasks in English and Chinese, with adjustable thinking…
Qwen · Kit
Runs Qwen3-8B as quantized GGUF files in llama.cpp or Ollama, with a thinking mode for math, code and logic and a plain mode for chat. For people who want a lo…
Qwen · Kit
Qwen's 8.2B open language model that switches between a thinking mode for hard problems and a plain mode for chat, with tool use and support for over 100 langu…
Qwen · Kit
The smallest Qwen3 chat model, built on Qwen3-0.6B-Base. It switches between a thinking mode and a quicker plain mode, handles 100+ languages and a 32,768-toke…
KRAFTON · Kit
Packs Raon-1 nano as a 4-bit LiteRT-LM bundle with a 4,096-token context, for running a Korean and English chat model on devices. Replies come without a thinki…
Qwen · Kit
Generates text with a 4B Qwen3 model that switches between a thinking mode for hard reasoning and a plain mode for quick chat. Suits developers who want a smal…