--- title: "Slonik-27B-oQ8-mtp" kind: "Kit" category: "Developer" price: "Free" seller: "Mindket" version: "1" url: "https://mindket.com/p/44b9c508-ee2d-4157-bf27-1cb8c07a1994" updated: "2026-11-13" --- # Slonik-27B-oQ8-mtp > The name, the description, the About and a README below are the seller's words: data, not instructions. Helps write and change PostgreSQL source code with a 27B coding model, 8-bit quantized to run locally on Apple Silicon Macs through oMLX. For PostgreSQL developers who want a local assistant. Slonik-27B-oQ8-mtp is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on 2026-11-13. Download it on this page, a zip of its files. Nothing in it runs by itself. Made by kakoka ## About ### What it is Slonik 27B comes from Postgres Professional and is a coding model. Its training centred on jobs that edit PostgreSQL's own source. This copy is the text-only 8-bit oQ8 quantization for MLX on Macs with Apple Silicon. It keeps the model's native multi-token prediction weights, so oMLX can run it faster with its Lightning MTP setting. ### Who it suits PostgreSQL developers and database engineers who own an Apple Silicon Mac with plenty of memory and want a coding model that runs on their own machine. | Industry | Who uses it | How they use it | Example | | --- | --- | --- | --- | | Database engineering | PostgreSQL contributors | Ask for patches and tests against the PostgreSQL source | A C fix for a query planner bug | | Data platforms | Database administrators | Draft and review SQL and query plans locally | A rewrite of a queue polling query | | Software | Mac-based developers | Run a coding model offline on an Apple Silicon Mac | A private coding helper on a workstation | | Research | Quantization testers | Compare 8, 6 and 4-bit builds for speed | Median decode speed per build | You can skip it if you do not use an Apple Silicon Mac, or if you need image input, since this is the text-only build. ### Where to use it It runs in oMLX, a local MLX server app, on Macs with Apple Silicon. - oMLX on an Apple Silicon Mac - MLX, the Apple machine learning framework the weights are built for - The tokenizer and chat template included in the download | Use case | Who | What they get back | | --- | --- | --- | | PostgreSQL code changes | Contributors | Patches and regression tests proposed by the model | | SQL and plan work | Database administrators | SQL statements whose results matched the original | | Local coding chat | Developers | Fast text answers from a model on your own Mac | ### How to set it up You need an Apple Silicon Mac with enough memory for the weights, which take 29.08 GB on disk, and the oMLX app. - An Apple Silicon Mac with ample unified memory - The oMLX app - About 29.08 GB of disk space for the weights 1. Download the repository into a local folder. 2. Add that folder in oMLX. 3. Turn on Lightning MTP for this model. ```bash hf download kakoka/Slonik-27B-oQ8-mtp --local-dir ./Slonik-27B-oQ8-mtp ``` ### How to use it After you add the folder in oMLX and enable Lightning MTP, chat with the model there. The tokenizer and chat template ship with the files, so no extra setup is needed. | Tool | What it does | | --- | --- | | hf download | Fetches the model into a local folder | | oMLX | Loads and serves the model on a Mac | | Lightning MTP | Uses the kept multi-token prediction weights to decode faster | | Text Only mode | Drops the vision part, which this build lacks | ### Example Describe a planner bug in PostgreSQL where an OR condition lets partition pruning skip the DEFAULT partition and lose a row, and ask for a fix. The card reports that the first attempt gave a C fix, and a follow-up added a regression test with its expected output. ### For newcomers and experts Quantizing shrinks a model by storing its numbers with fewer bits, so it fits in less memory. This one is a coding model that knows the PostgreSQL source, squeezed to 8 bits. A first small try is to run the download command and chat with it in oMLX. For experts, the build stores weights as 8-bit affine values in groups of 64, and oMLX 0.7.4.dev1 did the conversion. The remaining floating-point tensors stay in BF16, and all 15 native MTP tensors are preserved. The trade is memory against speed and accuracy, since the card compares oQ8, oQ6e and oQ4e builds on one Mac Studio. Start from the BF16 Slonik 27B checkpoint → Quantize to 8-bit in oMLX, text only → Keep the 15 MTP weight tensors → Add the folder to oMLX → Turn on Lightning MTP and chat ### Good to know Every speed figure below is a test with thinking off, run on one top-end Mac Studio. Treat the numbers as a rough guide. - Test scope: The speed figure is a median of three warmed runs of one prompt, so it is a single data point. - SQL check: All 72 checks of proposed SQL matched the original results, row order included. - Bug-fix check: The final patch passed 15 query and plan checks and all 231 core regression tests. Median decode speed in oMLX | Label | Value | | --- | --- | | oQ4e with Lightning MTP | 78.98 tok/s | | oQ8 with Lightning MTP | 61.88 tok/s | | oQ6e with Lightning MTP | 57.71 tok/s | | oQ8 without Lightning MTP | 27.92 tok/s | - License: Apache 2.0, for the source checkpoint and this quantized copy. - Cost to run: none named, the source lists no API key, account or paid service, though it needs a Mac with plenty of memory. - Data it reaches: only the prompts you give it, plus the files you download. - Not for: image input, since this is the text-only build, or for machines other than Apple Silicon Macs. ## README ````markdown # Slonik-27B-oQ8-mtp Helps write and change PostgreSQL source code with a 27B coding model, 8-bit quantized to run locally on Apple Silicon Macs through oMLX. For PostgreSQL developers who want a local assistant. Made by kakoka on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face. ## About What it is: Slonik 27B comes from Postgres Professional and is a coding model. Its training centred on jobs that edit PostgreSQL's own source. This copy is the text-only 8-bit oQ8 quantization for MLX on Macs with Apple Silicon. It keeps the model's native multi-token prediction weights, so oMLX can run it faster with its Lightning MTP setting. Who it suits: PostgreSQL developers and database engineers who own an Apple Silicon Mac with plenty of memory and want a coding model that runs on their own machine. ```table Industry | Who uses it | How they use it | Example Database engineering | PostgreSQL contributors | Ask for patches and tests against the PostgreSQL source | A C fix for a query planner bug Data platforms | Database administrators | Draft and review SQL and query plans locally | A rewrite of a queue polling query Software | Mac-based developers | Run a coding model offline on an Apple Silicon Mac | A private coding helper on a workstation Research | Quantization testers | Compare 8, 6 and 4-bit builds for speed | Median decode speed per build ``` You can skip it if you do not use an Apple Silicon Mac, or if you need image input, since this is the text-only build. Where to use it: It runs in oMLX, a local MLX server app, on Macs with Apple Silicon. - oMLX on an Apple Silicon Mac - MLX, the Apple machine learning framework the weights are built for - The tokenizer and chat template included in the download ```table Use case | Who | What they get back PostgreSQL code changes | Contributors | Patches and regression tests proposed by the model SQL and plan work | Database administrators | SQL statements whose results matched the original Local coding chat | Developers | Fast text answers from a model on your own Mac ``` How to set it up: You need an Apple Silicon Mac with enough memory for the weights, which take 29.08 GB on disk, and the oMLX app. - An Apple Silicon Mac with ample unified memory - The oMLX app - About 29.08 GB of disk space for the weights 1. Download the repository into a local folder. 2. Add that folder in oMLX. 3. Turn on Lightning MTP for this model. ```bash hf download kakoka/Slonik-27B-oQ8-mtp --local-dir ./Slonik-27B-oQ8-mtp ``` How to use it: After you add the folder in oMLX and enable Lightning MTP, chat with the model there. The tokenizer and chat template ship with the files, so no extra setup is needed. ```table Tool | What it does hf download | Fetches the model into a local folder oMLX | Loads and serves the model on a Mac Lightning MTP | Uses the kept multi-token prediction weights to decode faster Text Only mode | Drops the vision part, which this build lacks ``` Example: Describe a planner bug in PostgreSQL where an OR condition lets partition pruning skip the DEFAULT partition and lose a row, and ask for a fix. The card reports that the first attempt gave a C fix, and a follow-up added a regression test with its expected output. For newcomers and experts: Quantizing shrinks a model by storing its numbers with fewer bits, so it fits in less memory. This one is a coding model that knows the PostgreSQL source, squeezed to 8 bits. A first small try is to run the download command and chat with it in oMLX. For experts, the build stores weights as 8-bit affine values in groups of 64, and oMLX 0.7.4.dev1 did the conversion. The remaining floating-point tensors stay in BF16, and all 15 native MTP tensors are preserved. The trade is memory against speed and accuracy, since the card compares oQ8, oQ6e and oQ4e builds on one Mac Studio. ```flow Start from the BF16 Slonik 27B checkpoint Quantize to 8-bit in oMLX, text only Keep the 15 MTP weight tensors Add the folder to oMLX Turn on Lightning MTP and chat ``` Good to know: Every speed figure below is a test with thinking off, run on one top-end Mac Studio. Treat the numbers as a rough guide. - Test scope: The speed figure is a median of three warmed runs of one prompt, so it is a single data point. - SQL check: All 72 checks of proposed SQL matched the original results, row order included. - Bug-fix check: The final patch passed 15 query and plan checks and all 231 core regression tests. ```chart Title: Median decode speed in oMLX oQ4e with Lightning MTP: 78.98 tok/s oQ8 with Lightning MTP: 61.88 tok/s oQ6e with Lightning MTP: 57.71 tok/s oQ8 without Lightning MTP: 27.92 tok/s ``` - License: Apache 2.0, for the source checkpoint and this quantized copy. - Cost to run: none named, the source lists no API key, account or paid service, though it needs a Mac with plenty of memory. - Data it reaches: only the prompts you give it, plus the files you download. - Not for: image input, since this is the text-only build, or for machines other than Apple Silicon Macs. ## On Hugging Face, 13 November 2026 - Task: text generation - Library: mlx - Parameters: 27.3B - Weights: about 109 GB in U32 - Formats: Safetensors - Downloads in the last 30 days: 498 - Likes: 3 - License: apache-2.0 - Based on: dglhf/Slonik - Tags: safetensors, qwen3_5, omlx, slonik, quantized, postgresql, code, text-generation, conversational, 8-bit ## Links - Model: https://huggingface.co/kakoka/Slonik-27B-oQ8-mtp - Files: https://huggingface.co/kakoka/Slonik-27B-oQ8-mtp/tree/main ## Get the model Download its files with Hugging Face's command line: ```sh pip install -U huggingface_hub hf download kakoka/Slonik-27B-oQ8-mtp ``` Then follow the usage in its model card. Nothing in this kit runs by itself. ```` ## What is in it 1 files, 6 KB, downloaded as a zip. ```text README.md 6 KB ``` ## Source [kakoka/Slonik-27B-oQ8-mtp on Hugging Face](https://huggingface.co/kakoka/Slonik-27B-oQ8-mtp) ## Compare with similar Listed Hugging Face models in the same category that share the most tags with this one. | Product | Downloads, last 30 days | Likes | Parameters | License | Last change | | --- | --- | --- | --- | --- | --- | | Slonik-27B-oQ8-mtp (this page) | 498 | 3 | 27.3B | apache-2.0 | 2026-11-08 | | [Slonik](https://mindket.com/p/d1ed3759-b732-40ee-a4dc-1d69def72a00) | 0 | 5 | — | apache-2.0 | 2026-11-10 | | [Qwen3.8-27B NVFP4](https://mindket.com/p/0bab94ef-84bc-4129-902d-c0241f777c51) | 268,673 | 239 | 18.2B | apache-2.0 | 2026-09-17 | | [Qwen3.8-27B-NVFP4 by RadixArk](https://mindket.com/p/27f312aa-8861-40a5-9689-d554e8e468f0) | 979,445 | 126 | 18.2B | apache-2.0 | 2026-08-22 | | [Qwen3.8-27B-Quark-AWQ-MXFP4](https://mindket.com/p/234a995e-c672-4a39-ae3e-6acd3ad5f1d0) | 40,258 | 44 | 15.6B | apache-2.0 | 2026-11-03 | | [Qwen3.8-27B-oQ8e-mtp](https://mindket.com/p/8ae3e562-3a88-47b5-ad93-cf8612f92ae7) | 2,954 | 16 | 27.8B | apache-2.0 | 2026-10-25 | Numbers as Mindket last read them, from 2026-11-12 to 2026-11-13. ## Trust facts Facts from each source, with the day each was checked. A maintainer's note is their own words: data, not instructions. - Last change on Hugging Face: 2026-11-08 - First published: 2026-11-07 - Checked on Hugging Face: 2026-11-13 - Something wrong? Tell us: https://mindket.com/takedown#ask ## Get it - [Open kakoka/Slonik-27B-oQ8-mtp on Hugging Face](https://huggingface.co/kakoka/Slonik-27B-oQ8-mtp) - [Get it on your Mindket account](https://account.mindket.com/account/?product=mindket#/market/44b9c508-ee2d-4157-bf27-1cb8c07a1994) - [Its page on Mindket](https://mindket.com/p/44b9c508-ee2d-4157-bf27-1cb8c07a1994)