Bonsai-27B-GGUF
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
A 685B open reasoning model from DeepSeek with sparse attention for long context and a chat template that lets it think while it calls tools. For teams that run large models and build agents.
DeepSeek-V3.2 is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.
pip install -U huggingface_hub hf download deepseek-ai/DeepSeek-V3.2
DeepSeek-V3.2 is a 685B text model from DeepSeek, built on DeepSeek-V3.2-Exp-Base. It aims to pair efficiency with strong reasoning and agent skills. The maker names three changes: a sparse attention method called DSA for long context, a scaled-up reinforcement learning stage, and a large pipeline that synthesizes training tasks for tool use. A higher-compute variant, DeepSeek-V3.2-Speciale, is also described.
It suits ML teams that host huge open models, and developers who build agents that must reason while they call tools.
| Industry | Who uses it | How they use it | Example |
|---|---|---|---|
| Software development | Agent builders | Build assistants that call tools while they reason | The new chat template adds thinking with tools |
| Research | Teams that check model claims | Review the contest submissions the maker released | The card ships IOI, ICPC World Finals, IMO and CMO files for checking |
| Platform engineering | Teams that host open models | Serve a large model with an efficient attention method | DSA is built to cut compute on long inputs |
You can skip it if you have no multi-GPU server, since the weights are about 685 GB.
| Use case | Who | What they get back |
|---|---|---|
| Tool-using agents | Developers | A model that can reason between tool calls |
| Long-context work | Platform teams | Lower compute from sparse attention, as the maker states |
| Contest-style problems | Researchers | Submissions in a folder that others can verify |
You need Python, a lot of storage and a runtime that supports this model.
pip install -U huggingface_hub hf download deepseek-ai/DeepSeek-V3.2
The chat template changed from earlier versions. It has a new format for tool calling and a thinking with tools feature. The repository includes an encoding folder with Python scripts and test cases. They cover turning OpenAI-style messages into input strings, and reading the replies back as messages. The card's example is cut off after its import lines:
import transformers # encoding/encoding_dsv32.py from encoding_dsv32 import encode_messages, parse_message_from_completion_text
| Tool | What it does |
|---|---|
| encode_messages | Turns OpenAI-style messages into an input string for the model |
| parse_message_from_completion_text | Reads the model's text output back into a message |
| encoding folder | Holds the Python scripts and test cases for the template |
| olympiad_cases folder | Holds the contest submissions released for checking |
You build an agent that answers questions with a search tool. You encode the chat history with the template, so the model can think, call the tool, and think again. Then you parse its reply back into a message.
Think of it as a huge reasoning engine that is trained to use tools as part of its thinking. A first small try is to read the encoding scripts to see how one message becomes model input.
Sparse attention lets each token look at a selected part of the context, which lowers compute on long inputs. The maker says this keeps quality while it cuts cost. It also says the high-compute variant surpasses GPT-5 and matches Gemini-3.0-Pro on reasoning. Those are the maker's claims, and the charts are images that are not readable here.
Weights come in two sizes in the card's record.
| Format | Size |
|---|---|
| F8_E4M3 | About 685 GB |
| 4-bit, estimated | About 343 GB |
A 685B open reasoning model from DeepSeek with sparse attention for long context and a chat template that lets it think while it calls tools. For teams that run large models and build agents.
Made by deepseek-ai on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.
What it is: DeepSeek-V3.2 is a 685B text model from DeepSeek, built on DeepSeek-V3.2-Exp-Base. It aims to pair efficiency with strong reasoning and agent skills. The maker names three changes: a sparse attention method called DSA for long context, a scaled-up reinforcement learning stage, and a large pipeline that synthesizes training tasks for tool use. A higher-compute variant, DeepSeek-V3.2-Speciale, is also described.
Who it suits: It suits ML teams that host huge open models, and developers who build agents that must reason while they call tools.
Industry | Who uses it | How they use it | Example
Software development | Agent builders | Build assistants that call tools while they reason | The new chat template adds thinking with tools
Research | Teams that check model claims | Review the contest submissions the maker released | The card ships IOI, ICPC World Finals, IMO and CMO files for checking
Platform engineering | Teams that host open models | Serve a large model with an efficient attention method | DSA is built to cut compute on long inputs
You can skip it if you have no multi-GPU server, since the weights are about 685 GB.
Where to use it:
Use case | Who | What they get back
Tool-using agents | Developers | A model that can reason between tool calls
Long-context work | Platform teams | Lower compute from sparse attention, as the maker states
Contest-style problems | Researchers | Submissions in a folder that others can verify
How to set it up: You need Python, a lot of storage and a runtime that supports this model.
pip install -U huggingface_hub
hf download deepseek-ai/DeepSeek-V3.2
How to use it: The chat template changed from earlier versions. It has a new format for tool calling and a thinking with tools feature. The repository includes an encoding folder with Python scripts and test cases. They cover turning OpenAI-style messages into input strings, and reading the replies back as messages. The card's example is cut off after its import lines:
import transformers
# encoding/encoding_dsv32.py
from encoding_dsv32 import encode_messages, parse_message_from_completion_text
Tool | What it does
encode_messages | Turns OpenAI-style messages into an input string for the model
parse_message_from_completion_text | Reads the model's text output back into a message
encoding folder | Holds the Python scripts and test cases for the template
olympiad_cases folder | Holds the contest submissions released for checking
Example: You build an agent that answers questions with a search tool. You encode the chat history with the template, so the model can think, call the tool, and think again. Then you parse its reply back into a message.
For newcomers and experts: Think of it as a huge reasoning engine that is trained to use tools as part of its thinking. A first small try is to read the encoding scripts to see how one message becomes model input.
Sparse attention lets each token look at a selected part of the context, which lowers compute on long inputs. The maker says this keeps quality while it cuts cost. It also says the high-compute variant surpasses GPT-5 and matches Gemini-3.0-Pro on reasoning. Those are the maker's claims, and the charts are images that are not readable here.
Write messages in OpenAI style
Encode them with the card's scripts
The model thinks and may call a tool
Parse the reply with the card's parser
Feed the tool result back and continue
Good to know: Weights come in two sizes in the card's record.
Title: Weight sizes
Format | Size
F8_E4M3 | About 685 GB
4-bit, estimated | About 343 GB
Download its files with Hugging Face's command line:
pip install -U huggingface_hub
hf download deepseek-ai/DeepSeek-V3.2
Then follow the usage in its model card. Nothing in this kit runs by itself.
README.md 6 KB
Listed Hugging Face models in the same category that share the most tags with this one.
| Product | Downloads, last 30 days | Likes | Parameters | License | Last change |
|---|---|---|---|---|---|
| DeepSeek-V3.2 This page | 8,260,197 | 1,597 | 685B | mit | |
| DeepSeek-V4.1-FlashShares fp8 · text-generation · transformers | 1,759,335 | 4,949 | 763B | mit | |
| DeepSeek-R1Shares fp8 · text-generation · transformers | 1,599,170 | 14,451 | 684B | mit | |
| DeepSeek-V4-FlashShares fp8 · text-generation · transformers | 1,192,571 | 2,393 | 291B | mit | |
| DeepSeek-V4.1-Flash-1017Shares fp8 · text-generation · transformers | 398,161 | 5,600 | 763B | mit | |
| Kolibri-1Shares fp8 · text-generation · transformers | 13,319 | 1,011 | 78.1B | apache-2.0 |
Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search and on Trendshift. Mindket doesn’t write or check them. Open one to read it where it was posted.
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
LibertAIDAI · Kit
Runs DeepSeek-V4.1-Flash-1017 as a 2.9 bits-per-weight EXL3 quantization, a 196 GiB copy for people serving large models on their own hardware. Perplexity stay…
facebook · Kit
Generates short music clips from a text description or an audio prompt, in the small checkpoint of facebook's MusicGen. It suits developers and music hobbyists…
alpindale · Kit
Tags every character of C source code for syntax highlighting with a tiny neural network of about 984 weights, run through a small C program. For developers an…
prithivMLmods · Kit
Try a set of LoRAs for the FLUX.2 Klein image model in a Gradio app that runs in your browser or on your own computer. Made for people who make or test AI imag…
Sokheng · Kit
Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…