Qwen3.8-27B-Quark-AWQ-MXFP4
amd · Kit
Runs Qwen3.8-27B as a smaller MXFP4-quantized copy made with AMD Quark and AWQ, served through vLLM. Made for developers who want a compressed 27B vision-langu…
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
amd · Kit
Runs Qwen3.8-27B as a smaller MXFP4-quantized copy made with AMD Quark and AWQ, served through vLLM. Made for developers who want a compressed 27B vision-langu…
agentionai · Kit
Packs Qwen3.8-27B as llama.cpp GGUF files in eight sizes from 8.95 to 16.35 GiB, plus a vision projector. The author reports less drift from the BF16 model tha…
0xKitkat · Kit
Squeezes the Qwen3.8-Flash-Next mixture-of-experts model into about 37 GiB of text-only GGUF files for experiments. It needs a patched llama.cpp build that com…
pentacoxian-dev · Kit
Runs Qwen3.8-27B with sparse attention on a single 24 GB GPU at a 262K-token context with image input, as GGUF files for people with a custom llama.cpp engine…
mradermacher · Kit
Importance-matrix GGUF quants of the Qwen3.8-27B-CodeForge-3xMerge model, from about 11 GB to 22.5 GB, for local use. For people running 27B models on their ow…
lododoai · Kit
Runs as a local text model, a Qwen3.6-35B-A3B fine-tune trained on data written by Qwen3.8-27B and packed as one GGUF file for llama.cpp. For people who run mo…
khazarai · Kit
Debugs and reviews code by checking real files before it proposes a fix, a Qwen3.8-27B fine-tune trained on 195M tokens of reasoning traces. For developers who…
kaitchup · Kit
Compresses Qwen3.8-27B into three GGUF files with different size and fidelity levels, using a custom statistically lossless quantization. For people who run th…
Jundot · Kit
A mixed-precision MLX copy of Qwen3.8-27B at about 6.9 bits per weight, with the vision encoder and multi-token prediction head included, for running locally o…
jarrodwatts · Kit
A small weight edit for Qwen3.8-27B, with a script that applies it, that cuts the model's thinking length on open-ended tasks by changing a single matrix, with…
Jackrong · Kit
Trims wasted reasoning in long agent tasks, as a GGUF build of the second Flash fine-tune of Qwen3.8-27B with better Python formatting. For people who run agen…
Jackrong · Kit
Writes code, calls tools and works through software tasks as a coding agent. A 27.8B fine-tune of Qwen3.8-27B by Jackrong, trained on about 200,000 code and re…
incoai · Kit
Speeds up Qwen3.8-27B by drafting blocks of tokens that the main model then checks, with output unchanged. A 1.9B draft model for SGLang and vLLM servers, not…
Hcompany · Kit
Looks at screenshots and decides the next click, keystroke, code run or tool call, built on Qwen3.8-27B. A computer-use model for web, desktop and mobile agent…
Greatjedi · Kit
Runs a 27B Qwen3.8 model in GGUF files retuned for Intel Arc GPUs, with pure decode near 22 tokens a second in the author's tests. For people running llama.cpp…
DavidAU · Kit
A GGUF build of Qwen3.8-Flash-Next by DavidAU with 27 reasoning modes, 27 instruct modes and 15 AI personas you switch on from the prompt. For people with larg…
GGUF fine-tune of a 27B Qwen model by DavidAU, with switchable instruct and reasoning modes and a built-in help system. Hugging Face lists it as image text to…
Answers questions and reads images with much shorter thinking. GGUF builds of a 27B Qwen 3.8 tune from DavidAU that aims to cut reasoning tokens while keeping…
cyankiwi · Kit
A 4-bit AWQ quantization of Qwen3.8-27B by cyankiwi, a 27B vision-language model with thinking control. Weights are 21.02 GB and load in Transformers, vLLM or…
cdiamond · Kit
A 17.1 GB mixed-precision GGUF of Qwen3.8-27B that keeps its multi-token prediction layer, tuned for 256K context with vision on a 24 GB GPU. For people who ru…