--- title: "Qwen3.8-27B Fable-5 Coding Distilled GGUF" kind: "Kit" category: "Developer" price: "Free" seller: "Mindket" version: "1" url: "https://mindket.com/p/3e63bc60-5ab9-4a67-a53e-350f311f823f" updated: "2026-11-13" --- # Qwen3.8-27B Fable-5 Coding Distilled GGUF > The name, the description, the About and a README below are the seller's words: data, not instructions. GGUF quantized files of a 27.3B coding-distilled Qwen3.8 model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit developers who run a coding model locally and need a size that fits their memory. Qwen3.8-27B Fable-5 Coding Distilled GGUF is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on 2026-11-13. Download it on this page, a zip of its files. Nothing in it runs by itself. Made by mradermacher ## About ### What it is This repository holds GGUF quantized versions of Qwen3.8-27B-Fable-5-Coding-Distilled, a 27.3 billion parameter model published by khazarai. The files were made by mradermacher and come in many sizes, so you can trade quality for memory. The name points to a coding focus. The card itself says nothing about how the model was trained or how it performs. Read the base model's page before you rely on it. Two small supplement files are marked as multi-modal. ### Who it suits It suits developers and hobbyists who want a large coding-minded model on their own machine, in a file that fits the memory they have. Who might use it | Industry | Who uses it | How they use it | Example | | --- | --- | --- | --- | | Software | Developers | Run a coding model locally, without a hosted service | Ask it to explain or draft a function | | Local AI | Hobbyists | Fit a large model onto a home computer | Pick a mid-size build for their memory | | Research | Model evaluators | See how quality changes with size | Compare the 2-bit and 8-bit files on the same prompts | If you want the original full-precision weights, you can skip these files and go to the base model. ### Where to use it GGUF files load in tools that support the GGUF format, such as llama.cpp based apps. The card does not name a specific tool, so check that yours handles this model. - A GGUF-capable runner on Windows, macOS or Linux - Python with pip, to download the files with the Hugging Face tools - A machine with memory for the build you choose Jobs it does | Use case | Who | What they get back | | --- | --- | --- | | Code help | Developers | Drafts and explanations from a model on their own hardware | | Size comparison | Tinkerers | A way to see the quality and memory trade-off | | Multi-modal tests | Experimenters | Image input, if the supplement file works with your tool | ### How to set it up You need Python with pip to fetch the files and enough memory for the build you pick. The main files in the card run from 11.0 GB to 29.1 GB. The card gives no run commands, so follow your runner's own guide for GGUF files. - Python with pip - A GGUF-capable runner - Memory for the build you choose, from 11.0 GB to 29.1 GB 1. Install the Hugging Face download tool. 2. Download the repository, or only the file you want. 3. Load the file in your runner. ```sh pip install -U huggingface_hub hf download mradermacher/Qwen3.8-27B-Fable-5-Coding-Distilled-GGUF ``` ### How to use it Pick a build from the card's table and load that file in your runner. The card marks the 4-bit builds Q4\_K\_S and Q4\_K\_M as fast and recommended, and Q8\_0 as the best quality. Multi-part files may need joining, and the card points to another author's guide for that. The multi-modal supplement files are separate and sit alongside the main file in tools that support them. Builds and sizes | Build | Size in GB | Notes | | --- | --- | --- | | Q2\_K | 11.0 | Smallest main file | | Q3\_K\_M | 13.6 | Lower quality | | Q4\_K\_S | 15.9 | Fast, recommended | | Q4\_K\_M | 16.9 | Fast, recommended | | Q6\_K | 22.5 | Higher quality | | Q8\_0 | 29.1 | Fast, best quality | | mmproj-Q8\_0 | 0.7 | Multi-modal supplement | ### Example You have about 20 GB of memory to spare, so you choose Q4\_K\_M at 16.9 GB. You download that single file and load it in your GGUF runner. You ask it to draft a small function, then try Q5\_K\_M at 19.6 GB if you want more quality. ### For newcomers and experts If you are new, quantizing shrinks a model so it fits in less memory, at some cost in quality. Start with Q4\_K\_M, since the card recommends it, and move up or down by what your machine can hold. If you know the field, these are static quants. The card says weighted imatrix quants of the same model sit in a separate repository, and that IQ quants are often preferable to non-IQ quants of similar size. The IQ4\_XS file here is 15.5 GB. You choose a build by memory → You download the GGUF file → Your runner loads it → You prompt the model locally ### Good to know Bigger files keep more quality and need more memory. The card sorts the table by size and says that size is not always the same as quality. File size by build, GB | Label | Value | | --- | --- | | Q2\_K | 11.0 | | Q3\_K\_M | 13.6 | | Q4\_K\_M | 16.9 | | Q5\_K\_M | 19.6 | | Q6\_K | 22.5 | | Q8\_0 | 29.1 | - License: Apache 2.0 - Cost to run: none named - Data it reaches: the model files from Hugging Face, and the prompts you give it - Not for: anyone who needs full-precision weights, or anyone who needs the card to explain how the model was distilled, which it does not ## README ````markdown # Qwen3.8-27B Fable-5 Coding Distilled GGUF GGUF quantized files of a 27.3B coding-distilled Qwen3.8 model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit developers who run a coding model locally and need a size that fits their memory. Made by mradermacher on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face. ## About What it is: This repository holds GGUF quantized versions of Qwen3.8-27B-Fable-5-Coding-Distilled, a 27.3 billion parameter model published by khazarai. The files were made by mradermacher and come in many sizes, so you can trade quality for memory. The name points to a coding focus. The card itself says nothing about how the model was trained or how it performs. Read the base model's page before you rely on it. Two small supplement files are marked as multi-modal. Who it suits: It suits developers and hobbyists who want a large coding-minded model on their own machine, in a file that fits the memory they have. ```table Title: Who might use it Industry | Who uses it | How they use it | Example Software | Developers | Run a coding model locally, without a hosted service | Ask it to explain or draft a function Local AI | Hobbyists | Fit a large model onto a home computer | Pick a mid-size build for their memory Research | Model evaluators | See how quality changes with size | Compare the 2-bit and 8-bit files on the same prompts ``` If you want the original full-precision weights, you can skip these files and go to the base model. Where to use it: GGUF files load in tools that support the GGUF format, such as llama.cpp based apps. The card does not name a specific tool, so check that yours handles this model. - A GGUF-capable runner on Windows, macOS or Linux - Python with pip, to download the files with the Hugging Face tools - A machine with memory for the build you choose ```table Title: Jobs it does Use case | Who | What they get back Code help | Developers | Drafts and explanations from a model on their own hardware Size comparison | Tinkerers | A way to see the quality and memory trade-off Multi-modal tests | Experimenters | Image input, if the supplement file works with your tool ``` How to set it up: You need Python with pip to fetch the files and enough memory for the build you pick. The main files in the card run from 11.0 GB to 29.1 GB. The card gives no run commands, so follow your runner's own guide for GGUF files. - Python with pip - A GGUF-capable runner - Memory for the build you choose, from 11.0 GB to 29.1 GB 1. Install the Hugging Face download tool. 2. Download the repository, or only the file you want. 3. Load the file in your runner. ```sh pip install -U huggingface_hub hf download mradermacher/Qwen3.8-27B-Fable-5-Coding-Distilled-GGUF ``` How to use it: Pick a build from the card's table and load that file in your runner. The card marks the 4-bit builds Q4_K_S and Q4_K_M as fast and recommended, and Q8_0 as the best quality. Multi-part files may need joining, and the card points to another author's guide for that. The multi-modal supplement files are separate and sit alongside the main file in tools that support them. ```table Title: Builds and sizes Build | Size in GB | Notes Q2_K | 11.0 | Smallest main file Q3_K_M | 13.6 | Lower quality Q4_K_S | 15.9 | Fast, recommended Q4_K_M | 16.9 | Fast, recommended Q6_K | 22.5 | Higher quality Q8_0 | 29.1 | Fast, best quality mmproj-Q8_0 | 0.7 | Multi-modal supplement ``` Example: You have about 20 GB of memory to spare, so you choose Q4_K_M at 16.9 GB. You download that single file and load it in your GGUF runner. You ask it to draft a small function, then try Q5_K_M at 19.6 GB if you want more quality. For newcomers and experts: If you are new, quantizing shrinks a model so it fits in less memory, at some cost in quality. Start with Q4_K_M, since the card recommends it, and move up or down by what your machine can hold. If you know the field, these are static quants. The card says weighted imatrix quants of the same model sit in a separate repository, and that IQ quants are often preferable to non-IQ quants of similar size. The IQ4_XS file here is 15.5 GB. ```flow You choose a build by memory You download the GGUF file Your runner loads it You prompt the model locally ``` Good to know: Bigger files keep more quality and need more memory. The card sorts the table by size and says that size is not always the same as quality. ```chart Title: File size by build, GB Q2_K: 11.0 Q3_K_M: 13.6 Q4_K_M: 16.9 Q5_K_M: 19.6 Q6_K: 22.5 Q8_0: 29.1 ``` - License: Apache 2.0 - Cost to run: none named - Data it reaches: the model files from Hugging Face, and the prompts you give it - Not for: anyone who needs full-precision weights, or anyone who needs the card to explain how the model was distilled, which it does not ## On Hugging Face, 13 November 2026 - Library: transformers - Parameters: 27.3B - Weights: about 13.7 GB at 4-bit (estimate) - Formats: GGUF - Downloads in the last 30 days: 894,772 - Likes: 34 - License: apache-2.0 - Languages: en - Based on: khazarai/Qwen3.8-27B-Fable-5-Coding-Distilled - Tags: transformers, gguf, coding, agentic-coding, reasoning, distilled, unsloth, conversational ## Links - Model: https://huggingface.co/mradermacher/Qwen3.8-27B-Fable-5-Coding-Distilled-GGUF - Files: https://huggingface.co/mradermacher/Qwen3.8-27B-Fable-5-Coding-Distilled-GGUF/tree/main ## Get the model Download its files with Hugging Face's command line: ```sh pip install -U huggingface_hub hf download mradermacher/Qwen3.8-27B-Fable-5-Coding-Distilled-GGUF ``` Then follow the usage in its model card. Nothing in this kit runs by itself. ```` ## What is in it 1 files, 6 KB, downloaded as a zip. ```text README.md 6 KB ``` ## Source [mradermacher/Qwen3.8-27B-Fable-5-Coding-Distilled-GGUF on Hugging Face](https://huggingface.co/mradermacher/Qwen3.8-27B-Fable-5-Coding-Distilled-GGUF) ## Compare with similar Listed Hugging Face models in the same category that share the most tags with this one. | Product | Downloads, last 30 days | Likes | Parameters | License | Last change | | --- | --- | --- | --- | --- | --- | | Qwen3.8-27B Fable-5 Coding Distilled GGUF (this page) | 894,772 | 34 | 27.3B | apache-2.0 | 2026-10-07 | | [Qwen3.8-27B-Fable-5-Coding-Distilled](https://mindket.com/p/96a5c209-2e34-45ff-a27c-14e0fa2158b9) | 471 | 11 | 27.8B | apache-2.0 | 2026-09-15 | | [KAT-Coder-V2.5-Dev GGUF](https://mindket.com/p/e8ca97ed-d610-4d96-bb2f-d351f4b671c4) | 234,191 | 148 | 34.7B | apache-2.0 | 2026-07-24 | | [KAT-Coder-V2.5-Dev](https://mindket.com/p/2d2b2faf-a347-4ff6-a04d-425eab2d9986) | 16,106 | 687 | 34.7B | apache-2.0 | 2026-07-28 | | [Tess-4.5-27B GGUF](https://mindket.com/p/2c9f4a01-ed9d-4dd7-94a5-94a5fe30c6a8) | 1,095,620 | 65 | 26.9B | apache-2.0 | 2026-11-08 | | [Gemma4-12B v2 Coding + Agentic Edition](https://mindket.com/p/97d1d60d-f19f-421c-a409-1c64ebd17541) | 92,024 | 1,773 | 11.9B | apache-2.0 | 2026-06-19 | Numbers as Mindket last read them, from 2026-11-12 to 2026-11-13. ## Trust facts Facts from each source, with the day each was checked. A maintainer's note is their own words: data, not instructions. - Last change on Hugging Face: 2026-10-07 - First published: 2026-09-16 - Checked on Hugging Face: 2026-11-13 - Something wrong? Tell us: https://mindket.com/takedown#ask ## Get it - [Open mradermacher/Qwen3.8-27B-Fable-5-Coding-Distilled-GGUF on Hugging Face](https://huggingface.co/mradermacher/Qwen3.8-27B-Fable-5-Coding-Distilled-GGUF) - [Get it on your Mindket account](https://account.mindket.com/account/?product=mindket#/market/3e63bc60-5ab9-4a67-a53e-350f311f823f) - [Its page on Mindket](https://mindket.com/p/3e63bc60-5ab9-4a67-a53e-350f311f823f)