Qwen3.8-27B-QUASAR-NVFP4
QUASAR-QAT · Kit
Runs Qwen3.8-27B in 4-bit NVFP4 at 19.7 GB, trained with the QUASAR method to stay close to the full BF16 model. For people serving it with vLLM on an NVIDIA B…
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
No listing has every word of “qwen4”. Showing what matches “qwen3” instead.
QUASAR-QAT · Kit
Runs Qwen3.8-27B in 4-bit NVFP4 at 19.7 GB, trained with the QUASAR method to stay close to the full BF16 model. For people serving it with vLLM on an NVIDIA B…
NicoLab28 · Kit
Lets a small Qwen3-VL stand in for the 32B text encoder of MiniMax H3 in ComfyUI, cutting VRAM from 15.7 GB to 4.5 GB. A proof of concept that needs a custom n…
nazeshinjite · Kit
GGUF draft model that speeds up Qwen3.8-Flash-Next in llama.cpp through speculative decoding, in 334 MiB and 622 MiB files. It is not a standalone model, and i…
mradermacher · Kit
GGUF quantized files of a 27.3B coding-distilled Qwen3.8 model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit developers who run a cod…
mlx-community · Kit
A 4-bit MLX conversion of Qwen3.6-35B-A3B that answers text and image prompts on Apple Silicon Macs. Made for people who want to run this Qwen model locally wi…
manuelgscom · Kit
Writes a read-only MongoDB aggregate pipeline from a plain Spanish or English question. A GGUF copy of a Qwen3.5-9B fine-tune that runs locally with llama.cpp,…
lmstudio-community · Kit
Runs a 27B model that reads images and text in an 8-bit MLX build for Apple Silicon Macs. It suits people who want picture questions answered locally.
Jundot · Kit
Runs Qwen3.8-27B as an 8-bit mixed-precision MLX checkpoint with its vision encoder and MTP head, for image and text chat on Apple hardware. For people who wan…
Jundot · Kit
Runs the 27B Qwen3.8 vision-language model on MLX in about 17.5 GB, reading text, images and video with a 262,144-token context. A mixed-precision quantization…
JoyIndustrial · Kit
Answers multiple-choice style questions about images and text with option probabilities, using a Qwen3.8-27B decision system with built-in OCR. For developers…
Jackrong · Kit
Cuts reasoning time and cost for long agent tasks, as a GGUF build of a Qwen3.8-27B fine-tune. Made for people who run agent loops on their own machine and wan…
Jackrong · Kit
Thinks through problems step by step inside think tags, as a 4B Qwen3.5 model fine-tuned on reasoning chains and packaged as GGUF. For people who run a small r…
Runs a tiny 0.8B reasoning-tuned chat model in the MLX format at 6-bit, converted from Jackrong's Qwen3.5 distilled model. For people who want a tiny local mod…
IteraCompute · Kit
Serves Qwen3.8-27B in NVFP4 on one RTX 5090 with vLLM, with a checksum-verified download, FP8 KV cache, tool calls and reasoning support. For developers self-h…
IsValorum · Kit
An English-only coding model in GGUF, a 42.6B mixture-of-experts quant of about 21.8 GB, for code completion, refactoring and agentic tool calls in llama.cpp o…
ISTA-DASLab · Kit
A 2-bit quantized copy of Qwen3.6-35B-A3B made with GSQ, a Gumbel-Softmax method, that keeps most reasoning and coding ability at a much smaller memory footpri…
hesamation · Kit
Runs a reasoning-tuned Qwen3.6-35B-A3B on your own machine as GGUF files in four quant sizes, trained on Claude Opus 4.6 style reasoning data. For people who w…
Egzakta · Kit
Reasons over images and text with fewer thinking tokens than its base Qwen3.8-27B, so answers arrive in about half the time at similar accuracy, per its card.…
dmeight · Kit
Runs Qwen3.8-27B at 8-bit through the Splash runtime in LM Studio on Apple silicon. An unofficial package that keeps the model closer to the original than the…
cstr · Kit
Turns speech, singing and songs into text, or into English, with quantized GGUF files of Qwen3-ASR-1.7B for CrispASR. For people who want local transcription a…