Bonsai-27B-GGUF
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
Speeds up MiniCPM-OCR 1.0 by drafting tokens that the main model checks in one pass. A draft head, not a standalone OCR model, for people who self-host document parsing.
MiniCPM-OCR 1.0 DSpark is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.
pip install -U huggingface_hub hf download openbmb/MiniCPM-OCR-1.0-DSpark
MiniCPM-OCR 1.0 DSpark is a small draft head for speculative decoding, made by openbmb for the MiniCPM-OCR 1.0 document reader. It proposes several tokens at once and the main model verifies them in a single pass. It cannot do OCR alone, so you load it alongside the main MiniCPM-OCR 1.0 model.
It suits people who already run MiniCPM-OCR 1.0 and want documents to finish sooner. Researchers who study draft models can read its design too.
| Industry | Who uses it | How they use it | Example |
|---|---|---|---|
| Document processing | Teams that parse many documents | Pair the head with MiniCPM-OCR 1.0 to finish documents sooner | Turning a batch of scanned pages into Markdown or JSON |
| Inference engineering | Engineers who self-host the model | Add the draft head to a serving setup for the main checkpoint | A self-hosted MiniCPM-OCR 1.0 service with this head added |
| Research | Researchers on speculative decoding | Study how a small draft head is built | Reading its five draft layers and 15 draft tokens per pass |
You can skip it if you want an OCR model that runs alone, since this head cannot.
| Use case | Who | What they get back |
|---|---|---|
| Faster document parsing | Teams with many pages | The same parsing job with less decoding time |
| Self-hosted OCR service | Engineers | A serving stack where the main model verifies drafted tokens |
| Draft model study | Researchers | A checkpoint with documented layers and vocabulary sizes |
pip install -U huggingface_hub hf download openbmb/MiniCPM-OCR-1.0-DSpark
You do not call the head yourself. The minicpm-ocr SDK parses a document in two stages, and the head speeds up the second one when the service is set up with it.
| Tool | What it does |
|---|---|
| minicpm-ocr SDK | Runs the two stage document parsing and builds the final Markdown or JSON |
| PP-DocLayoutV3 | Finds text, tables, formulas and other regions, and sets reading order |
| MiniCPM-OCR 1.0 service | Reads each cropped region and returns its content |
| DSpark head | Drafts tokens that the main model verifies in one pass |
One detail matters if you load the head by hand. The d2t tensor stores differences, so convert it to absolute token IDs before use:
d2t[i] + i
The file local-to-target.json holds the correct absolute IDs to check against.
You send a scanned report page to the SDK. It cuts the page into regions, the service reads each region with a prompt that fits its type, and you get Markdown or JSON back in reading order.
This is a helper, not a model you talk to. It guesses the next several tokens so the main model can check them together instead of producing them one at a time. For a first try, use the project's playground for the main model, then move to self-hosting when you need speed.
Underneath, the head has 5 layers and proposes 15 tokens per forward pass, reading hidden states from five layers of the target model. Its output vocabulary is cropped to 114,688 tokens from an input vocabulary of 248,100, and the d2t mapping links the two. The card reports a 55% gain in end to end processing efficiency with the head attached.
These are the head's published specifications and speed figures.
| Property | Value |
|---|---|
| Target model | MiniCPM-OCR 1.0 (1.3B) |
| Draft parameters | 296,837,889 |
| Draft layers | 5 |
| Draft tokens per forward pass | 15 |
| Checkpoint precision | BF16 |
Speeds up MiniCPM-OCR 1.0 by drafting tokens that the main model checks in one pass. A draft head, not a standalone OCR model, for people who self-host document parsing.
Made by openbmb on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.
What it is: MiniCPM-OCR 1.0 DSpark is a small draft head for speculative decoding, made by openbmb for the MiniCPM-OCR 1.0 document reader. It proposes several tokens at once and the main model verifies them in a single pass. It cannot do OCR alone, so you load it alongside the main MiniCPM-OCR 1.0 model.
Who it suits: It suits people who already run MiniCPM-OCR 1.0 and want documents to finish sooner. Researchers who study draft models can read its design too.
Industry | Who uses it | How they use it | Example
Document processing | Teams that parse many documents | Pair the head with MiniCPM-OCR 1.0 to finish documents sooner | Turning a batch of scanned pages into Markdown or JSON
Inference engineering | Engineers who self-host the model | Add the draft head to a serving setup for the main checkpoint | A self-hosted MiniCPM-OCR 1.0 service with this head added
Research | Researchers on speculative decoding | Study how a small draft head is built | Reading its five draft layers and 15 draft tokens per pass
You can skip it if you want an OCR model that runs alone, since this head cannot.
Where to use it:
Use case | Who | What they get back
Faster document parsing | Teams with many pages | The same parsing job with less decoding time
Self-hosted OCR service | Engineers | A serving stack where the main model verifies drafted tokens
Draft model study | Researchers | A checkpoint with documented layers and vocabulary sizes
How to set it up:
pip install -U huggingface_hub
hf download openbmb/MiniCPM-OCR-1.0-DSpark
How to use it: You do not call the head yourself. The minicpm-ocr SDK parses a document in two stages, and the head speeds up the second one when the service is set up with it.
Tool | What it does
minicpm-ocr SDK | Runs the two stage document parsing and builds the final Markdown or JSON
PP-DocLayoutV3 | Finds text, tables, formulas and other regions, and sets reading order
MiniCPM-OCR 1.0 service | Reads each cropped region and returns its content
DSpark head | Drafts tokens that the main model verifies in one pass
One detail matters if you load the head by hand. The d2t tensor stores differences, so convert it to absolute token IDs before use:
d2t[i] + i
The file local-to-target.json holds the correct absolute IDs to check against.
Example: You send a scanned report page to the SDK. It cuts the page into regions, the service reads each region with a prompt that fits its type, and you get Markdown or JSON back in reading order.
For newcomers and experts: This is a helper, not a model you talk to. It guesses the next several tokens so the main model can check them together instead of producing them one at a time. For a first try, use the project's playground for the main model, then move to self-hosting when you need speed.
Underneath, the head has 5 layers and proposes 15 tokens per forward pass, reading hidden states from five layers of the target model. Its output vocabulary is cropped to 114,688 tokens from an input vocabulary of 248,100, and the d2t mapping links the two. The card reports a 55% gain in end to end processing efficiency with the head attached.
A page goes to the SDK
The layout model finds regions and reading order
The draft head proposes tokens
The main model verifies them in one pass
Markdown or JSON comes out
Good to know: These are the head's published specifications and speed figures.
Property | Value
Target model | MiniCPM-OCR 1.0 (1.3B)
Draft parameters | 296,837,889
Draft layers | 5
Draft tokens per forward pass | 15
Checkpoint precision | BF16
Title: Throughput with the head, as a multiple of each other system
PaddleOCR-VL-1.6: 1.49 times
MinerU2.5 Pro: 3.62 times
Download its files with Hugging Face's command line:
pip install -U huggingface_hub
hf download openbmb/MiniCPM-OCR-1.0-DSpark
Then follow the usage in its model card. Nothing in this kit runs by itself.
README.md 6 KB
Listed Hugging Face models in the same category that share the most tags with this one.
| Product | Downloads, last 30 days | Likes | Parameters | License | Last change |
|---|---|---|---|---|---|
| MiniCPM-OCR 1.0 DSpark This page | 12,549 | 14 | 297M | apache-2.0 | |
| Spark-X2.6-4B-DSpark-GGUFShares dspark · draft-model · speculative-decoding | 4,008 | 29 | 624M | apache-2.0 | |
| Spark-X2.6-1.7B-DSpark-GGUFShares dspark · draft-model · speculative-decoding | 969 | 10 | 345M | apache-2.0 | |
| MiniCPM-V-4.7-1B-ggufShares dspark · speculative-decoding · multimodal | 168,636 | 114 | 1B | apache-2.0 | |
| Qwen3.8-27B-DFlash2 by incoaiShares draft-model · speculative-decoding · qwen3 | 429,580 | 301 | 1.9B | apache-2.0 | |
| Qwen3.8-Flash-Next-DFlash2Shares draft-model · speculative-decoding · qwen3 | 58,226 | 84 | 603M | apache-2.0 |
Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search and on Trendshift. Mindket doesn’t write or check them. Open one to read it where it was posted.
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
LibertAIDAI · Kit
Runs DeepSeek-V4.1-Flash-1017 as a 2.9 bits-per-weight EXL3 quantization, a 196 GiB copy for people serving large models on their own hardware. Perplexity stay…
facebook · Kit
Generates short music clips from a text description or an audio prompt, in the small checkpoint of facebook's MusicGen. It suits developers and music hobbyists…
alpindale · Kit
Tags every character of C source code for syntax highlighting with a tiny neural network of about 984 weights, run through a small C program. For developers an…
prithivMLmods · Kit
Try a set of LoRAs for the FLUX.2 Klein image model in a Gradio app that runs in your browser or on your own computer. Made for people who make or test AI imag…
Sokheng · Kit
Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…