Qwen3.5-4B GGUF
bartowski · Kit
Imatrix GGUF quantizations of Qwen3.5-4B, a 4.3B image-text model with MTP layers, with the 4-bit file near 3 GB. For people who run a small model locally.
New
Browse AI skills, agents and automations
Categories and filters
Listings
Qwen3.8-Whittle-MoE-27B-MLX-4bit
barozp · Kit
A 4-bit MLX build for Apple Silicon of a mixture-of-experts model carved from the dense Qwen3.8-27B, with 17.8B active of 27B total parameters. For people who…
New
MOSS-Image-SFT GGUF
axiomofmind · Kit
Unofficial GGUF files of the MOSS-Image-SFT diffusion transformer in Q8_0 and Q4_K_S, for running text-to-image locally with stable-diffusion.cpp. Needs a sepa…
New
Qwen3.8-27B-NVFP4-DGX-SPARK
autotrust · Kit
Speeds up Qwen3.8-27B NVFP4 decoding about 3.9 times on a DGX Spark, using the same weights and a tuned speculative-decoding setup. For teams serving it with v…
New
Qwen3.8-27B-Quark-AWQ-MXFP4
amd · Kit
Runs Qwen3.8-27B as a smaller MXFP4-quantized copy made with AMD Quark and AWQ, served through vLLM. Made for developers who want a compressed 27B vision-langu…
New
Qwen3.5-35B-A3B-GGUF
unsloth · Kit
Reads text and images, writes code and calls tools on your own machine, as Unsloth's refreshed GGUF files for the Qwen3.5 35B-A3B vision-language model. For de…
New
DSpine
tencent · Kit
Drafts several tokens at once for speculative decoding with Qwen3-8B, so a model server can check them in one pass. For inference engineers and speculative dec…
New
Qwen3.8-27B Agention Precision GGUF
agentionai · Kit
Packs Qwen3.8-27B as llama.cpp GGUF files in eight sizes from 8.95 to 16.35 GiB, plus a vision projector. The author reports less drift from the BF16 model tha…
New
Occamy-1.0
Accio-Lab · Kit
An open 35B image and text model from Accio-Lab, based on Qwen3.6-35B-A3B, in BF16, GGUF, FP8, NVFP4 and MLX formats. For teams that serve a large model.
New
Qwen3.8-Flash-Next-125B-UltraLite-37GiB-GGUF
0xKitkat · Kit
Squeezes the Qwen3.8-Flash-Next mixture-of-experts model into about 37 GiB of text-only GGUF files for experiments. It needs a patched llama.cpp build that com…
New
Laplace-1-Atlas
JuneoAI · Kit
Helps organizations decide who does a task, who sees information, what runs and what gets accepted, by scoring candidate options in one pass. A 27.4B model bui…
New
VideoJev-4B
ZhuYuhan · Kit
Finds when an event happens in a video and answers multiple-choice questions about it, by scoring candidates directly. Built on Qwen3.5-4B for video researcher…
New
OpenBonsai Qwen3.5-9B Ternary
webbrain-one · Kit
Runs Qwen3.5-9B squeezed to ternary weights in a roughly 2 GB GGUF file, for CPU use in two llama.cpp variants. A research preview for people who experiment wi…
New
Qwen3.6-27B-MTP-GGUF
unsloth · Kit
Codes and reasons with Qwen3.6 27B in GGUF files by Unsloth that carry multi-token prediction, which the card says speeds up replies about 1.5 to 2 times with…
New
Qwen3.5-0.8B-MTP-GGUF
unsloth · Kit
Runs the small Qwen3.5 0.8B vision-language model in llama.cpp with multi-token prediction for faster generation, as Unsloth's GGUF files. For developers testi…
New
NeoHorse-1-9B
TokenRhythm · Kit
A 9B text model post-trained from Qwen3.5-9B for agent frameworks, tool use, coding and instruction following, released as text-only weights. For developers wh…
New
GameScaling
THUSI-Lab · Kit
A small vision-language model built on Qwen3.5-0.8B from a research project on continued pre-training for embodied agents in many virtual game worlds. For rese…
New
Qwen3Guard-Stream-0.6B
Qwen · Kit
Checks text for safety token by token while a language model is still writing, rating each part safe, controversial or unsafe in 119 languages and dialects. Su…
New
Qwen3Guard-Gen-0.6B
Qwen · Kit
A small safety moderation model that labels a prompt or a model reply as safe, controversial or unsafe and names the risk categories, in 119 languages. Suits d…
New
Qwen3-Embedding-0.6B-GGUF
Qwen · Kit
Turns text into number vectors for search, retrieval and clustering in more than 100 languages, as a 0.6B model in GGUF format. Suits developers building searc…
New
Qwen3-1.7B-GGUF
Qwen · Kit
Gives you the small Qwen3 1.7B chat model as a q8_0 GGUF file for llama.cpp, with a switch between thinking and non-thinking replies. For people who want a lig…
New
Qwen3-1.7B-Base
Qwen · Kit
Continues text and code as a 1.7B base language model pre-trained on 119 languages. For developers who want a small model to fine-tune or test.
New
Qwen3-1.7B
Qwen · Kit
A compact 1.7B chat model that switches between a thinking mode for reasoning and a quick mode for dialogue. Suits developers who want a small open model for c…
New
Qwen3.8-27B-QSA-GSQ-RCO-GGUF
pentacoxian-dev · Kit
Runs Qwen3.8-27B with sparse attention on a single 24 GB GPU at a 262K-token context with image input, as GGUF files for people with a custom llama.cpp engine…
New
NousCoder-14B
NousResearch · Kit
Writes code for competitive programming problems, a Qwen3-14B model trained further with reinforcement learning on 24k problems with checkable answers. For dev…
New
Qwen3.5-0.8B-weight-space-programming-GGUF by NotCherry
NotCherry · Kit
Packages the Qwen3.5-0.8B weight-space-programming model as GGUF files for llama.cpp, with a 4-bit text model and a separate vision projector for image input.
New
Qwen3.8-27B-CodeForge-3xMerge i1 GGUF
mradermacher · Kit
Importance-matrix GGUF quants of the Qwen3.8-27B-CodeForge-3xMerge model, from about 11 GB to 22.5 GB, for local use. For people running 27B models on their ow…
New
Qwen3.6-35B-A3B-8bit (MLX)
mlx-community · Kit
8-bit MLX conversion of Qwen3.6-35B-A3B that reads text and images and answers in text, run with the mlx-vlm tool. For developers who want to run a large visio…
New
Qwen3.5-9B-OptiQ-4bit
mlx-community · Kit
A 4-bit mixed-precision MLX version of Qwen3.5-9B for local text generation on Apple Silicon, with a bundled multi-token prediction head. For Mac users who run…
New
Qwen3.5-4B-Router-1M
MaziyarPanahi · Kit
Small decider that returns a calibrated probability for what an agent should do next and which tool it should call. For developers building agents and support…
New
Qwen3.5-4B-Judge-1M
MaziyarPanahi · Kit
Small judge model that returns a calibrated probability on whether a reply is backed by its source, whether text is unsafe, and which task or domain it belongs…
New
Temper-2-Nodel
maylore-ai · Kit
Rust coding model of 4.2B parameters, built on Qwen3.5-4B, that answers requests in Russian and English. For Rust developers who want a small model for functio…
New
Qwen3.6-35B-A3B lododo-Distill-v1.0 (GGUF)
lododoai · Kit
Runs as a local text model, a Qwen3.6-35B-A3B fine-tune trained on data written by Qwen3.8-27B and packed as one GGUF file for llama.cpp. For people who run mo…
New
Qwen3.8-27B-Fable-5-Coding-Distilled
khazarai · Kit
Debugs and reviews code by checking real files before it proposes a fix, a Qwen3.8-27B fine-tune trained on 195M tokens of reasoning traces. For developers who…
New
Qwen3.8-27B-SLQ-GGUF
kaitchup · Kit
Compresses Qwen3.8-27B into three GGUF files with different size and fidelity levels, using a custom statistically lossless quantization. For people who run th…
New
Qwen3.8-27B-oQ6e-mtp
Jundot · Kit
A mixed-precision MLX copy of Qwen3.8-27B at about 6.9 bits per weight, with the vision encoder and multi-token prediction head included, for running locally o…
New
Qwen3.6-35B-A3B-oQ6e-mtp
Jundot · Kit
A mixed-precision MLX copy of Qwen3.6-35B-A3B at about 6.8 bits per weight, with the vision encoder and multi-token prediction head included, for running local…
New
Qwen3.8-27B Astra stop edit
jarrodwatts · Kit
A small weight edit for Qwen3.8-27B, with a script that applies it, that cuts the model's thinking length on open-ended tasks by changing a single matrix, with…
New
Qwopus3.8-27B-Flash-V2-GGUF
Jackrong · Kit
Trims wasted reasoning in long agent tasks, as a GGUF build of the second Flash fine-tune of Qwen3.8-27B with better Python formatting. For people who run agen…
New
Qwopus3.8-27B-Coder-Flash
Jackrong · Kit
Writes code, calls tools and works through software tasks as a coding agent. A 27.8B fine-tune of Qwen3.8-27B by Jackrong, trained on about 200,000 code and re…
New
Seb-9B-v2
ironbcc · Kit
A 9B decision model based on Qwen3.5-9B. You give it a situation, a question and options, and it returns how likely each option is, in one pass with no text ge…
New
Qwen3.8-27B-DFlash2 by incoai
incoai · Kit
Speeds up Qwen3.8-27B by drafting blocks of tokens that the main model then checks, with output unchanged. A 1.9B draft model for SGLang and vLLM servers, not…
New
Holo4-27B
Hcompany · Kit
Looks at screenshots and decides the next click, keystroke, code run or tool call, built on Qwen3.8-27B. A computer-use model for web, desktop and mobile agent…
New
Qwen3.8-27B Intel Arc Tuned
Greatjedi · Kit
Runs a 27B Qwen3.8 model in GGUF files retuned for Intel Arc GPUs, with pure decode near 22 tokens a second in the author's tests. For people running llama.cpp…
New
Qwen3-Reranker-0.6B-Q8_0-GGUF
ggml-org · Kit
Ranks passages by relevance to a query, as an 8-bit GGUF copy of the Qwen3 0.6B reranker made with llama.cpp. For developers who want a small local reranker fo…
New
Qwen3.5-4B-SFT-decompiler-O0-full
Divij · Kit
Rewrites decompiler output into readable C source with meaningful names and proper types. A Qwen3.5-4B fine-tune trained on unoptimized binaries, for security…
New
Qwenputer-npu
divagr1925 · Kit
A Qwen3.5-4B model with a small RISC-V computer built into its weights, used for exact arithmetic and for running a tiny story model. An experiment for researc…
New
Qwen3.5-4B Qwenputer Filesystem
divagr1925 · Kit
An experimental Qwen3.5-4B with a RISC-V CPU and a small filesystem compiled into its weights, so it remembers facts across sessions without outside tools. The…
New
Qwen3.8 Flash Next Turbo Brilliance 50x GGUF
DavidAU · Kit
A GGUF build of Qwen3.8-Flash-Next by DavidAU with 27 reasoning modes, 27 instruct modes and 15 AI personas you switch on from the prompt. For people with larg…
New
GGUF fine-tune of a 27B Qwen model by DavidAU, with switchable instruct and reasoning modes and a built-in help system. Hugging Face lists it as image text to…
New