Qwen3.8-27B-NVFP4 Deployment Edition
IteraCompute · Kit
Serves Qwen3.8-27B in NVFP4 on one RTX 5090 with vLLM, with a checksum-verified download, FP8 KV cache, tool calls and reasoning support. For developers self-h…
IteraCompute · Kit
Serves Qwen3.8-27B in NVFP4 on one RTX 5090 with vLLM, with a checksum-verified download, FP8 KV cache, tool calls and reasoning support. For developers self-h…
FINAL-Bench · Kit
Reads a situation and a set of typed questions, then returns a probability for every option in one forward pass, with no text generated. For builders adding ca…
Egzakta · Kit
Runs a 27B model that reads images and text, in FP8 for vLLM. It reasons with far fewer tokens than a Qwen model of the same size. Made for people who host the…
Egzakta · Kit
Reasons over images and text with fewer thinking tokens than its base Qwen3.8-27B, so answers arrive in about half the time at similar accuracy, per its card.…
dmeight · Kit
Runs Qwen3.8-27B at 8-bit through the Splash runtime in LM Studio on Apple silicon. An unofficial package that keeps the model closer to the original than the…
barozp · Kit
A 4-bit MLX build for Apple Silicon of a mixture-of-experts model carved from the dense Qwen3.8-27B, with 17.8B active of 27B total parameters. For people who…
autotrust · Kit
Speeds up Qwen3.8-27B NVFP4 decoding about 3.9 times on a DGX Spark, using the same weights and a tuned speculative-decoding setup. For teams serving it with v…
amd · Kit
Runs Qwen3.8-27B as a smaller MXFP4-quantized copy made with AMD Quark and AWQ, served through vLLM. Made for developers who want a compressed 27B vision-langu…
agentionai · Kit
Packs Qwen3.8-27B as llama.cpp GGUF files in eight sizes from 8.95 to 16.35 GiB, plus a vision projector. The author reports less drift from the BF16 model tha…
JuneoAI · Kit
Helps organizations decide who does a task, who sees information, what runs and what gets accepted, by scoring candidate options in one pass. A 27.4B model bui…
ZelligeAI · Kit
Runs coding-agent loops with a 27B model that thinks in a compressed English and Chinese shorthand, so it spends fewer thinking tokens per turn. For developers…
unsloth · Kit
Codes and reasons with Qwen3.6 27B in GGUF files by Unsloth that carry multi-token prediction, which the card says speeds up replies about 1.5 to 2 times with…
prism-ml · Kit
Runs a 27B-class reasoning model packed to 1 bit per weight, about 3.9 GB, on Apple MLX, with 262K-token context. For developers who want a large model on a ph…
pentacoxian-dev · Kit
Runs Qwen3.8-27B with sparse attention on a single 24 GB GPU at a 262K-token context with image input, as GGUF files for people with a custom llama.cpp engine…
OmniJev · Kit
Reads a screenshot, photo, video or text plus your typed questions and returns a probability for each answer option, such as what an agent should do next or wh…
mradermacher · Kit
Importance-matrix GGUF quants of the Qwen3.8-27B-CodeForge-3xMerge model, from about 11 GB to 22.5 GB, for local use. For people running 27B models on their ow…
migtissera · Kit
GGUF builds of Tess-4.5, a 27B open-weights coding and agent model, for llama.cpp, with a vision projector and optional draft heads for faster generation. They…
lododoai · Kit
Runs as a local text model, a Qwen3.6-35B-A3B fine-tune trained on data written by Qwen3.8-27B and packed as one GGUF file for llama.cpp. For people who run mo…
khazarai · Kit
Debugs and reviews code by checking real files before it proposes a fix, a Qwen3.8-27B fine-tune trained on 195M tokens of reasoning traces. For developers who…
kakoka · Kit
Helps write and change PostgreSQL source code with a 27B coding model, 8-bit quantized to run locally on Apple Silicon Macs through oMLX. For PostgreSQL develo…