Qwen3-30B-A3B-GGUF
Qwen · Kit
A 30.5B mixture-of-experts chat model in GGUF format with only 3.3B parameters active per token, runnable in llama.cpp or ollama. It has thinking and plain mod…
Qwen · Kit
A 30.5B mixture-of-experts chat model in GGUF format with only 3.3B parameters active per token, runnable in llama.cpp or ollama. It has thinking and plain mod…
Qwen · Kit
A small 0.6B chat model in GGUF format that runs locally in llama.cpp or ollama and can switch between thinking and plain replies. Suits people with modest har…
Qwen · Kit
A driving model built on Qwen3.5-4B that sees in 3D, answers questions about road scenes and plans future vehicle paths. For researchers working on autonomous…
QUASAR-QAT · Kit
Runs Qwen3.8-27B in 4-bit NVFP4 at 19.7 GB, trained with the QUASAR method to stay close to the full BF16 model. For people serving it with vLLM on an NVIDIA B…
NicoLab28 · Kit
Lets a small Qwen3-VL stand in for the 32B text encoder of MiniMax H3 in ComfyUI, cutting VRAM from 15.7 GB to 4.5 GB. A proof of concept that needs a custom n…
nazeshinjite · Kit
GGUF draft model that speeds up Qwen3.8-Flash-Next in llama.cpp through speculative decoding, in 334 MiB and 622 MiB files. It is not a standalone model, and i…
mradermacher · Kit
GGUF quantized files of a 27.3B coding-distilled Qwen3.8 model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit developers who run a cod…
mlx-community · Kit
A 4-bit MLX conversion of Qwen3.6-35B-A3B that answers text and image prompts on Apple Silicon Macs. Made for people who want to run this Qwen model locally wi…
miromind-ai · Kit
An open research agent model that reasons over long contexts and calls tools many times per task to look up information. The 8B size, built on Qwen3-8B, suits…
manuelgscom · Kit
Writes a read-only MongoDB aggregate pipeline from a plain Spanish or English question. A GGUF copy of a Qwen3.5-9B fine-tune that runs locally with llama.cpp,…
lordx64 · Kit
Thinks in explicit think blocks before it answers, tuned on about 8k reasoning traces from Claude Opus 4.7. A 35B mixture-of-experts Qwen3.6 variant for hard m…
lmstudio-community · Kit
Runs a 27B model that reads images and text in an 8-bit MLX build for Apple Silicon Macs. It suits people who want picture questions answered locally.
Jundot · Kit
Runs Qwen3.8-27B as an 8-bit mixed-precision MLX checkpoint with its vision encoder and MTP head, for image and text chat on Apple hardware. For people who wan…
Jundot · Kit
Runs the 27B Qwen3.8 vision-language model on MLX in about 17.5 GB, reading text, images and video with a 262,144-token context. A mixed-precision quantization…
JoyIndustrial · Kit
Answers multiple-choice style questions about images and text with option probabilities, using a Qwen3.8-27B decision system with built-in OCR. For developers…
Joakimpalm-Zen · Kit
Shrinks Qwen3.8-27B to a 3-bit IQ3_S GGUF with retrained scales. A research file for people who study quantization, not a faithful stand-in for the original mo…
Jackrong · Kit
Cuts reasoning time and cost for long agent tasks, as a GGUF build of a Qwen3.8-27B fine-tune. Made for people who run agent loops on their own machine and wan…
Jackrong · Kit
Thinks through problems step by step inside think tags, as a 4B Qwen3.5 model fine-tuned on reasoning chains and packaged as GGUF. For people who run a small r…
Runs a tiny 0.8B reasoning-tuned chat model in the MLX format at 6-bit, converted from Jackrong's Qwen3.5 distilled model. For people who want a tiny local mod…
IteraCompute · Kit
Serves Qwen3.8-27B in NVFP4 on one RTX 5090 with vLLM, with a checksum-verified download, FP8 KV cache, tool calls and reasoning support. For developers self-h…