Mindket

Qwen3.6-27B-GGUF

Newversion 1 · updated

Overview

Handles agentic coding and image-plus-text tasks locally, as Unsloth's GGUF files for Qwen3.6-27B with thinking preservation and a long context. For developers who run local coding agents.

Qwen3.6-27B-GGUF is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.

At a glance

You need
  • Python with pip, for the download
  • A runtime that can load GGUF files
  • Memory for about 13.4 GB at 4-bit, as an estimate
Runs in
  • llama.cpp and other tools that read GGUF files
  • Codex and OpenCode, since the card adds developer role support for them
  • Unsloth Studio, where the card says Qwen3.6 can be run and fine-tuned
  • Windows, macOS or Linux, where the files download with Python
Start with
pip install -U huggingface_hub
hf download unsloth/Qwen3.6-27B-GGUF

Platform

CodexCoding agent
OpenCodeCoding agent
WindowsOperating system
macOSOperating system
LinuxOperating system

About

What it is

This is Unsloth's GGUF copy of Qwen3.6-27B, the first open-weight model in the Qwen3.6 line. It is a causal language model with a vision encoder, listed at 26.9B parameters. The Qwen team says it improves agentic coding, especially frontend workflows and reasoning across a whole repository, and adds an option to keep reasoning from earlier messages.

Who it suits

It suits developers who want a local model for agentic coding, and teams who work through long edit sessions where earlier reasoning should carry over.

IndustryWho uses itHow they use itExample
SoftwareDevelopersRun a local coding agent model in Codex or OpenCodeWork on a frontend task in a repository
Product teamsEngineering teamsKeep reasoning context across iterative editsContinue a long change over many messages
ResearchML researchersStudy a hybrid of Gated DeltaNet and attention layersRead the layer layout in the card

Anyone without room for about 13.4 GB of 4-bit weights can skip it.

Where to use it

  • llama.cpp and other tools that read GGUF files
  • Codex and OpenCode, since the card adds developer role support for them
  • Unsloth Studio, where the card says Qwen3.6 can be run and fine-tuned
  • Windows, macOS or Linux, where the files download with Python
Use caseWhoWhat they get back
Agentic codingDevelopersCode and tool calls for frontend and repository work
Iterative developmentTeamsReplies that build on reasoning kept from earlier turns
Long documentsAnalystsAnswers over a context of up to 262,144 tokens

How to set it up

  • Python with pip, for the download
  • A runtime that can load GGUF files
  • Memory for about 13.4 GB at 4-bit, as an estimate
  1. Install the Hugging Face hub client.
  2. Download the repository's files.
  3. Load a file in your runtime and follow Unsloth's guide for settings.
pip install -U huggingface_hub
hf download unsloth/Qwen3.6-27B-GGUF

How to use it

Load a quantization and send it coding tasks or questions with images. Keep the context window at 128K tokens or more, because the card says shorter windows weaken its thinking. If memory runs out, shrink the window first. For heavy production serving, the Qwen team recommends engines such as SGLang, KTransformers or vLLM.

ToolWhat it does
Thinking preservationKeeps reasoning from earlier messages in the context
Developer role supportLets Qwen3.6 work inside Codex, OpenCode and similar tools
Unsloth StudioRuns and fine-tunes the model in a desktop interface

Example

You give the model a frontend task in a repository and keep the conversation going over several edits. With thinking preservation on, its earlier reasoning stays available as the work continues.

For newcomers and experts

Start with a 4-bit file and a short coding question. Add images or long conversations once the basics work.

The language model has 64 layers and a hidden width of 5120. Its layout repeats three Gated DeltaNet plus feed-forward layers, then one Gated Attention plus feed-forward layer, sixteen times. Gated Attention uses 24 query heads and 4 key-value heads. The card says it was trained with multi-step MTP.

  1. A task and its history go in
  2. The vision encoder reads any images
  3. The hybrid stack reasons over a long context
  4. Earlier reasoning can be kept
  5. Code or an answer comes out
Context length in tokens
Native context262,144 tokens
Extended context1,010,000 tokens

Good to know

  • Context: 262,144 tokens natively and extensible to 1,010,000
  • Size: 26.9B parameters in the record, with about 13.4 GB at 4-bit as an estimate
  • Tool calling: Unsloth says nested objects now parse better, so calls succeed more often
  • License: Apache 2.0
  • Cost to run: none named
  • Data it reaches: the text and images you give it, with no web or account access named
  • Not for: nothing named in the card

README and files

README

Qwen3.6-27B-GGUF

Handles agentic coding and image-plus-text tasks locally, as Unsloth's GGUF files for Qwen3.6-27B with thinking preservation and a long context. For developers who run local coding agents.

Made by unsloth on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.

About

What it is: This is Unsloth's GGUF copy of Qwen3.6-27B, the first open-weight model in the Qwen3.6 line. It is a causal language model with a vision encoder, listed at 26.9B parameters. The Qwen team says it improves agentic coding, especially frontend workflows and reasoning across a whole repository, and adds an option to keep reasoning from earlier messages.

Who it suits: It suits developers who want a local model for agentic coding, and teams who work through long edit sessions where earlier reasoning should carry over.

Industry | Who uses it | How they use it | Example
Software | Developers | Run a local coding agent model in Codex or OpenCode | Work on a frontend task in a repository
Product teams | Engineering teams | Keep reasoning context across iterative edits | Continue a long change over many messages
Research | ML researchers | Study a hybrid of Gated DeltaNet and attention layers | Read the layer layout in the card

Anyone without room for about 13.4 GB of 4-bit weights can skip it.

Where to use it:

  • llama.cpp and other tools that read GGUF files
  • Codex and OpenCode, since the card adds developer role support for them
  • Unsloth Studio, where the card says Qwen3.6 can be run and fine-tuned
  • Windows, macOS or Linux, where the files download with Python
Use case | Who | What they get back
Agentic coding | Developers | Code and tool calls for frontend and repository work
Iterative development | Teams | Replies that build on reasoning kept from earlier turns
Long documents | Analysts | Answers over a context of up to 262,144 tokens

How to set it up:

  • Python with pip, for the download
  • A runtime that can load GGUF files
  • Memory for about 13.4 GB at 4-bit, as an estimate
  1. Install the Hugging Face hub client.
  2. Download the repository's files.
  3. Load a file in your runtime and follow Unsloth's guide for settings.
pip install -U huggingface_hub
hf download unsloth/Qwen3.6-27B-GGUF

How to use it: Load a quantization and send it coding tasks or questions with images. Keep the context window at 128K tokens or more, because the card says shorter windows weaken its thinking. If memory runs out, shrink the window first. For heavy production serving, the Qwen team recommends engines such as SGLang, KTransformers or vLLM.

Tool | What it does
Thinking preservation | Keeps reasoning from earlier messages in the context
Developer role support | Lets Qwen3.6 work inside Codex, OpenCode and similar tools
Unsloth Studio | Runs and fine-tunes the model in a desktop interface

Example: You give the model a frontend task in a repository and keep the conversation going over several edits. With thinking preservation on, its earlier reasoning stays available as the work continues.

For newcomers and experts: Start with a 4-bit file and a short coding question. Add images or long conversations once the basics work.

The language model has 64 layers and a hidden width of 5120. Its layout repeats three Gated DeltaNet plus feed-forward layers, then one Gated Attention plus feed-forward layer, sixteen times. Gated Attention uses 24 query heads and 4 key-value heads. The card says it was trained with multi-step MTP.

A task and its history go in
The vision encoder reads any images
The hybrid stack reasons over a long context
Earlier reasoning can be kept
Code or an answer comes out
Title: Context length in tokens
Native context: 262,144 tokens
Extended context: 1,010,000 tokens

Good to know:

  • Context: 262,144 tokens natively and extensible to 1,010,000
  • Size: 26.9B parameters in the record, with about 13.4 GB at 4-bit as an estimate
  • Tool calling: Unsloth says nested objects now parse better, so calls succeed more often
  • License: Apache 2.0
  • Cost to run: none named
  • Data it reaches: the text and images you give it, with no web or account access named
  • Not for: nothing named in the card

On Hugging Face, 13 November 2026

  • Task: image text to text
  • Library: transformers
  • Parameters: 26.9B
  • Weights: about 13.4 GB at 4-bit (estimate)
  • Formats: GGUF
  • Downloads in the last 30 days: 227,770
  • Likes: 978
  • License: apache-2.0
  • Based on: Qwen/Qwen3.6-27B
  • Tags: transformers, gguf, unsloth, qwen, qwen3_5, image-text-to-text, imatrix, conversational

Links

Get the model

Download its files with Hugging Face's command line:

pip install -U huggingface_hub
hf download unsloth/Qwen3.6-27B-GGUF

Then follow the usage in its model card. Nothing in this kit runs by itself.

Files
README.md  5 KB

1 file, 5 KB, downloaded as a zip.

What’s new

  • Version 1 · 2026-11-13

Compare with similar

Listed Hugging Face models in the same category that share the most tags with this one.

ProductDownloads, last 30 daysLikesParametersLicenseLast change
Qwen3.6-27B-GGUF This page227,77097826.9Bapache-2.0
Qwen3.6-27B-MTP-GGUFShares qwen · imatrix · unsloth46,0351,34427.3Bapache-2.0
Qwen3.6-35B-A3B-MTP-GGUFShares qwen · imatrix · unsloth2,315,1671,05135.5Bapache-2.0
Qwen3.6-35B-A3B-GGUFShares qwen · imatrix · unsloth1,649,8711,78934.7Bapache-2.0
Qwopus3.8-27B-Flash-V2-GGUFShares qwen · unsloth · qwen3_5897,67575461Mapache-2.0
Qwen3.5-4B-MTP-GGUFShares qwen · unsloth · qwen3_5109,5001124.3Bapache-2.0
Numbers as Mindket last read them, from 2026-11-12 to 2026-11-13.

Reviews

No ratings yet

Write a review

No reviews yet.

What people say

Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search and on Trendshift. Mindket doesn’t write or check them. Open one to read it where it was posted.

kevincoxLaguna S 2.1This seems like a great option for local usage. With 16 GiB of VRAM on the official (https://huggingface.co/poolside/Laguna-S-2.1-GGUF) Q4_K_M quant (which seems to be recommended) I can get about 50 t/s in and 10 t/s out. Definitely not winning any speed benchmarks but totally usable for…Alexis "xals" Lahouze`smolclaw`, et `llama.cpp`, modèle `unsloth/Qwen3.6-27B-GGUF`, sur mon AMD Radeon RX 7900 XTX, je suis visiblement dans les 28 tokens par seconde en réponse. Je crois que je vais continuer à m'amuser dans cette configuration.1 like · 1 replycpburns2009Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?My LLM host is a Framework Desktop 128GB (Ryzen AI 395) with an RTX 5090 (Minisforum DEG1 dock, cheap Oculink card plugged into the PCIe 4.0 x4 slot). I run llama-server (b9296 compiled for CUDA) using a systemd service, and its configured as: # server-2.env LLAMA_ARGS="--host 0.0.0.0 --port 8082…Tommi Somersuohuggingface.co/unsloth/Qwen...amboo7How to setup a local coding agent on macOSTrying to recall... # 27B GGUF # Benchmark results: # - TG speed: ~5 tok/s (vs baseline ~4.5 tok/s, +10% improvement) # - PP speed: ~60 tok/s (stable across context sizes) # - With parallel=4: total throughput ~28 tok/s llama-server \ -m…デイリーHuggingFaceトレンド今日のHuggingFaceトレンド unsloth/Qwen3.6-27B-GGUF Qwen3.6-27Bというポストトレーニング済みモデルの重みと設定ファイルを提供するためのリポジトリです。 Hugging Face Transformers形式で提供されており、vLLMやSGLangなどの推論フレームワークに対応しています。 安定性と実用性を重視し、開発者のコーディング体験の向上やツール呼び出し機能の改善を図っています。xrdGranite 4.1: IBM's 8B Model Matching 32B MoEHow do you run it? vllm? llama.cpp? Can you share some parameters you enable tool calling and agentic usage? Or, higher level, some philosophies on what approaches you are using for tuning to get better tool calling and/or agentic usage? I'm having surprisingly good success with…デイリーHuggingFaceトレンド今日のHuggingFaceトレンド unsloth/Qwen3.6-27B-GGUF Qwen3.6-27Bのモデル重みと設定ファイルを公開するためのリポジトリです。 Hugging Face Transformers形式で提供され、vLLMやSGLangなどの推論フレームワークと互換性があります。 安定性と実用性を重視し、特に開発者のコーディング体験の向上やツール呼び出し機能の改善を目的としています。xrdShow HN: Utilyze – an open source GPU monitoring tool more accurate than nvtopI feel like this is tangential to this conversation. Does anyone know of a good tool for "load balancing" usage across local GPUs? Why: I have two RTX3090s (24GB). I've been using nvidia-smi to check usage of my RTX3090. Mostly I'm running llama.cpp with unsloth/Qwen3.6-27B-GGUF:Q4_K_M and getting…デイリーHuggingFaceトレンド今日のHuggingFaceトレンド unsloth/Qwen3.6-27B-GGUF Qwen3.6-27Bのポストトレーニング済みモデルの重みと設定ファイルを提供することが目的です。 Hugging Face Transformers形式で提供されており、vLLMやSGLangなどの推論フレームワークと互換性があります。 安定性と実用性を重視し、特にコーディング体験の向上やツール呼び出し機能の改善が図られています。 画像とテキストを入力とするマルチモーダルな機能も備えています。fy20Running local LLMs offline on a ten-hour flightRunning it on a Macbook Pro M5 48GB: -hf unsloth/Qwen3.6-27B-GGUF:UD-Q6_K_XL \ -c 128000 \ --parallel 1 \ --flash-attn on \ --no-context-shift \ --cache-type-k q8_0 \ --cache-type-v q8_0 \ --temp 0.6 \ --top-p 0.95 \ --top-k 20 \ --min-p 0.0 \ --presence_penalty 0.0 \ --reasoning on \ --jinja \…デイリーHuggingFaceトレンド今日のHuggingFaceトレンド unsloth/Qwen3.6-27B-GGUF このリポジトリは、Hugging Face形式の学習済みモデルQwen3.6-27Bの重みと設定ファイルを提供することを目的としています。 開発者にとってより直感的で生産的なコーディング体験、安定性、および実用性の向上を目指しており、vLLMやSGLangなどの主要な推論フレームワークと互換性があります。 また、ツール呼び出し機能の改善も含まれています。

Searched

More from Mindket

See all from Mindket

anaksor-ocr

Sokheng · Kit

Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…

New

Qwen2.5-7B-Instruct as GGUF files in eight quantization sizes, to chat with locally through llama.cpp. For people who want a capable 7.6B model on their own co…

New

ACE-Step 1.5 XL SFT

ACE-Step · Kit

Generates music from text with a 4B diffusion decoder, 50 steps and guidance control, aiming for higher audio quality than the base. For creators with a GPU of…

New

Similar in Developer

See all in Developer

Claude Code Skills & Plugins

alirezarezvani · Skill

Adds 411 ready-made skills for Claude Code and other coding agents, grouped by role from engineering and product to marketing, finance and compliance. Installs…

New29.8k

buzz

block · Kit

Self-hostable workspace where people and AI agents share the same rooms, built on a Nostr relay that logs every action as a signed event. For teams that want t…

New37.3k

plannotator

backnotprop · Kit

Opens your AI coding agent's plans, specs and code changes in a browser so you can annotate or comment on them and send the feedback straight back to the agent.

New10.5k