anaksor-ocr
Sokheng · Kit
Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…
Pairs with the Bielik-11B-v3.1-Instruct model as a draft model for speculative decoding in SGLang or vLLM. It is not a standalone language model.
Bielik-11B-v3.1-DFlash2 is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.
pip install -U huggingface_hub hf download speakleash/Bielik-11B-v3.1-DFlash2
Bielik-11B-v3.1-DFlash2 is a small draft model for speculative decoding. It is meant to run next to Bielik-11B-v3.1-Instruct, the larger target model, inside an inference server that supports DFlash. On its own it does not work as a language model.
It suits teams that already serve the Bielik-11B-v3.1-Instruct model, mainly for Polish, and want to try speculative decoding with a matching draft.
| Industry | Who uses it | How they use it | Example |
|---|---|---|---|
| Language technology | Polish NLP teams | Pair the draft with the Instruct model on their own server | Serving a Polish chat model through vLLM |
| Inference engineering | Platform engineers | Try DFlash speculative decoding in SGLang or vLLM | Comparing the two servers' launch setups |
| Research | Applied ML groups | Study draft models trained on the target's own data | Reading how the draft was trained on the same dataset |
You can skip it if you do not run the Instruct model, because the draft does nothing alone.
| Use case | Who | What they get back |
|---|---|---|
| Polish chat serving | Platform teams | A speculative decoding setup for the Instruct model |
| Server comparison | Inference engineers | One draft model tried in both SGLang and vLLM |
| Draft model study | Researchers | A draft trained on the same data as its target |
pip install -U huggingface_hub hf download speakleash/Bielik-11B-v3.1-DFlash2
The card's SGLang launch looks like this.
export SGLANG_ALLOW_OVERWRITE_LONGER_CONTEXT_LEN=1
python -m sglang.launch_server \
--model-path speakleash/Bielik-11B-v3.1-Instruct \
--speculative-algorithm DFLASH \
--speculative-draft-model-path speakleash/Bielik-11B-v3.1-DFlash2 \
--speculative-num-draft-tokens 16The card's vLLM launch looks like this.
vllm serve speakleash/Bielik-11B-v3.1-Instruct \
--speculative-config '{"method": "dflash", "model": "speakleash/Bielik-11B-v3.1-DFlash2", "num_speculative_tokens": 15}' \
--attention-backend flash_attn \
--max-num-batched-tokens 32768You start the server with the Instruct model as the main model and name this model as the draft. After that you use the server the way you already use the Instruct model.
| Tool | What it does |
|---|---|
| python -m sglang.launch_server | Starts SGLang with the target model and the draft |
| --speculative-num-draft-tokens | Sets how many tokens the draft proposes, 16 in the card's example |
| vllm serve | Starts vLLM with the target model |
| --speculative-config | Names the dflash method, the draft model and 15 draft tokens |
You launch vLLM with the Instruct model and this draft in the speculative config, then chat with the model in Polish as before. The replies come from the Instruct model, and the draft only proposes tokens for it to check.
A draft model is a small helper that guesses the next few words so a larger model can check them together. This one never writes answers alone. To start, download it and launch the vLLM example above.
If you know the field, this is a DFlash2 draft with 1.2B parameters, trained on the target's own dataset with a custom setup built on ALLaMo. The cost is that it ties you to one target model and to a server with DFlash support.
Pairs with the Bielik-11B-v3.1-Instruct model as a draft model for speculative decoding in SGLang or vLLM. It is not a standalone language model.
Made by speakleash on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.
What it is: Bielik-11B-v3.1-DFlash2 is a small draft model for speculative decoding. It is meant to run next to Bielik-11B-v3.1-Instruct, the larger target model, inside an inference server that supports DFlash. On its own it does not work as a language model.
Who it suits: It suits teams that already serve the Bielik-11B-v3.1-Instruct model, mainly for Polish, and want to try speculative decoding with a matching draft.
Industry | Who uses it | How they use it | Example
Language technology | Polish NLP teams | Pair the draft with the Instruct model on their own server | Serving a Polish chat model through vLLM
Inference engineering | Platform engineers | Try DFlash speculative decoding in SGLang or vLLM | Comparing the two servers' launch setups
Research | Applied ML groups | Study draft models trained on the target's own data | Reading how the draft was trained on the same dataset
You can skip it if you do not run the Instruct model, because the draft does nothing alone.
Where to use it:
Use case | Who | What they get back
Polish chat serving | Platform teams | A speculative decoding setup for the Instruct model
Server comparison | Inference engineers | One draft model tried in both SGLang and vLLM
Draft model study | Researchers | A draft trained on the same data as its target
How to set it up:
pip install -U huggingface_hub
hf download speakleash/Bielik-11B-v3.1-DFlash2
The card's SGLang launch looks like this.
export SGLANG_ALLOW_OVERWRITE_LONGER_CONTEXT_LEN=1
python -m sglang.launch_server \
--model-path speakleash/Bielik-11B-v3.1-Instruct \
--speculative-algorithm DFLASH \
--speculative-draft-model-path speakleash/Bielik-11B-v3.1-DFlash2 \
--speculative-num-draft-tokens 16
The card's vLLM launch looks like this.
vllm serve speakleash/Bielik-11B-v3.1-Instruct \
--speculative-config '{"method": "dflash", "model": "speakleash/Bielik-11B-v3.1-DFlash2", "num_speculative_tokens": 15}' \
--attention-backend flash_attn \
--max-num-batched-tokens 32768
How to use it: You start the server with the Instruct model as the main model and name this model as the draft. After that you use the server the way you already use the Instruct model.
Tool | What it does
python -m sglang.launch_server | Starts SGLang with the target model and the draft
--speculative-num-draft-tokens | Sets how many tokens the draft proposes, 16 in the card's example
vllm serve | Starts vLLM with the target model
--speculative-config | Names the dflash method, the draft model and 15 draft tokens
Example: You launch vLLM with the Instruct model and this draft in the speculative config, then chat with the model in Polish as before. The replies come from the Instruct model, and the draft only proposes tokens for it to check.
For newcomers and experts: A draft model is a small helper that guesses the next few words so a larger model can check them together. This one never writes answers alone. To start, download it and launch the vLLM example above.
If you know the field, this is a DFlash2 draft with 1.2B parameters, trained on the target's own dataset with a custom setup built on ALLaMo. The cost is that it ties you to one target model and to a server with DFlash support.
You send a request to the server
The draft proposes several tokens
The Instruct model checks them together
The accepted tokens form the reply
Good to know:
Title: Draft tokens in the card's two setups
SGLang setup: 16 draft tokens
vLLM setup: 15 draft tokens
Download its files with Hugging Face's command line:
pip install -U huggingface_hub
hf download speakleash/Bielik-11B-v3.1-DFlash2
Then follow the usage in its model card. Nothing in this kit runs by itself.
README.md 6 KB
Listed Hugging Face models in the same category that share the most tags with this one.
| Product | Downloads, last 30 days | Likes | Parameters | License | Last change |
|---|---|---|---|---|---|
| Bielik-11B-v3.1-DFlash2 This page | 44 | 3 | 1.2B | apache-2.0 | |
| Bielik-11B-v3.1-DFlashShares bielik · efficiency · diffusion-language-model | 36 | 3 | 1.2B | apache-2.0 | |
| Qwen3.8-27B-DFlash2 by incoaiShares block-diffusion · draft-model · speculative-decoding | 429,580 | 301 | 1.9B | apache-2.0 | |
| Qwen3.8-Flash-Next-DFlash2Shares block-diffusion · draft-model · speculative-decoding | 58,226 | 84 | 603M | apache-2.0 | |
| Qwen3.8-27B-DFlash2Shares block-diffusion · draft-model · speculative-decoding | 46,660 | 335 | 1.9B | apache-2.0 | |
| Flint-DFlash2Shares block-diffusion · draft-model · speculative-decoding | 1,651 | 9 | 403M | apache-2.0 |
Sokheng · Kit
Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…
Qwen · Kit
Qwen2.5-7B-Instruct as GGUF files in eight quantization sizes, to chat with locally through llama.cpp. For people who want a capable 7.6B model on their own co…
ACE-Step · Kit
Generates music from text with a 4B diffusion decoder, 50 steps and guidance control, aiming for higher audio quality than the base. For creators with a GPU of…
alirezarezvani · Skill
Adds 411 ready-made skills for Claude Code and other coding agents, grouped by role from engineering and product to marketing, finance and compliance. Installs…
block · Kit
Self-hostable workspace where people and AI agents share the same rooms, built on a Nostr relay that logs every action as a signed event. For teams that want t…
backnotprop · Kit
Opens your AI coding agent's plans, specs and code changes in a browser so you can annotate or comment on them and send the feedback straight back to the agent.