MiMo-V2.6-Distill-Qwen-9B-GSQ-RCO-GGUF
sainez · Kit
Gives you a 9B coding and tool-calling model as one 3.64 GiB GGUF file, quantized at about 3.5 bits per weight for running on your own machine.
sainez · Kit
Gives you a 9B coding and tool-calling model as one 3.64 GiB GGUF file, quantized at about 3.5 bits per weight for running on your own machine.
rapid-mlx · Kit
A 27B vision-language model compressed to 3.5 bits per weight for Apple Silicon Macs with 24 GB of memory, served locally through Rapid-MLX. Suits Mac users an…
RadixArk · Kit
A pre-quantized NVFP4 copy of Qwen3.8-27B that reads text, images and video and answers in text, served with SGLang on NVIDIA Blackwell GPUs. Suits developers…
Qwen · Kit
Reads images and text together and answers in text, as a mixture-of-experts model with 122B total and 10B active parameters. Suits teams with big GPU servers w…
Qwen · Kit
Runs the Qwen3 8B language model through the mlx library for chat, reasoning, translation and agent work. Suits developers who want a local text model with a s…
Qwen · Kit
A 30.5B mixture-of-experts chat model in GGUF format with only 3.3B parameters active per token, runnable in llama.cpp or ollama. It has thinking and plain mod…
Qwen · Kit
A small 0.6B chat model in GGUF format that runs locally in llama.cpp or ollama and can switch between thinking and plain replies. Suits people with modest har…
Qwen · Kit
Completes and generates code as a 7.6B base language model that developers can run, fine-tune or use for fill in the middle tasks. Built for people making codi…
Qwen · Kit
GGUF copy of a 32B code chat model that runs locally with llama.cpp. It writes, explains and fixes code from plain requests, for developers who want to run it…
Qwen · Kit
Writes, explains and fixes code as a tiny 494M-parameter chat model with a 32,768-token context. Suits developers who want the smallest open Qwen coding model…
Qwen · Kit
A 4-bit AWQ build of Qwen2.5-7B-Instruct, a 7.6B chat model that follows instructions, handles tables and returns JSON. For developers who want a capable chat…
Qwen · Kit
Answers questions, writes code, does maths and returns structured JSON as a 14.7B-parameter chat model with a context window up to 131,072 tokens. Suits develo…
Qwen · Kit
The smallest base model in Qwen2.5, about 494M parameters with a 32,768-token context, meant for further training on your own data. For developers who want a t…
Qwen · Kit
A judge model called Q-Judger that grades AI-made images against the prompt that asked for them, scoring five groups of criteria and replying in JSON. For peop…
Qwen · Kit
Generates images from text prompts in English or Chinese, with better human realism, natural detail and text in pictures than the August Qwen-Image. For develo…
Qwen · Kit
A driving model built on Qwen3.5-4B that sees in 3D, answers questions about road scenes and plans future vehicle paths. For researchers working on autonomous…
QUASAR-QAT · Kit
Runs Qwen3.8-27B in 4-bit NVFP4 at 19.7 GB, trained with the QUASAR method to stay close to the full BF16 model. For people serving it with vLLM on an NVIDIA B…
NicoLab28 · Kit
Lets a small Qwen3-VL stand in for the 32B text encoder of MiniMax H3 in ComfyUI, cutting VRAM from 15.7 GB to 4.5 GB. A proof of concept that needs a custom n…
NexaAI · Kit
Runs Qwen2-Audio locally to chat by voice and analyze audio, including speech translation, transcription and sound detection. GGUF copies for Nexa-SDK, for peo…
nazeshinjite · Kit
GGUF draft model that speeds up Qwen3.8-Flash-Next in llama.cpp through speculative decoding, in 334 MiB and 622 MiB files. It is not a standalone model, and i…