AI projects from Hugging Face

Qwen3.8-27B-DFlash2-GGUF by z-lab

z-lab · Kit

A draft model in GGUF form that speeds up Qwen3.8-27B by proposing token blocks for the main model to verify. For people who run that model locally with llama.…

MiniCPM-OCR 1.0 DSpark

openbmb · Kit

Speeds up MiniCPM-OCR 1.0 by drafting tokens that the main model checks in one pass. A draft head, not a standalone OCR model, for people who self-host documen…

Qwen3.8-Flash-Next-DFlash2-GGUF

nazeshinjite · Kit

GGUF draft model that speeds up Qwen3.8-Flash-Next in llama.cpp through speculative decoding, in 334 MiB and 622 MiB files. It is not a standalone model, and i…

Flint-DFlash2

incoai · Kit

A 403M-parameter draft model that speeds up serving of the Flint language model with speculative decoding in SGLang, without changing its output. It is not a s…

Bielik-11B-v3.1-DFlash2

speakleash · Kit

Pairs with the Bielik-11B-v3.1-Instruct model as a draft model for speculative decoding in SGLang or vLLM. It is not a standalone language model.

Bielik-11B-v3.1-DFlash

speakleash · Kit

Serves as the DFlash draft model that pairs with Bielik-11B-v3.1-Instruct for speculative decoding in SGLang or vLLM. It is not a standalone language model. Fo…

Qwen3.8-27B-DFlash2 by incoai

incoai · Kit

Speeds up Qwen3.8-27B by drafting blocks of tokens that the main model then checks, with output unchanged. A 1.9B draft model for SGLang and vLLM servers, not…

Spark-X2.6-1.7B-DSpark-GGUF

XHToken · Kit

A small draft model that speeds up Spark-X2.6-1.7B through speculative decoding, guessing up to seven tokens per step. For people who run that model locally on…

Spark-X2.6-4B-DSpark-GGUF

XHToken · Kit

Speeds up text generation for Spark-X2.6-4B as a small draft model for speculative decoding, in GGUF format. Meant for people running that model locally with l…

Qwen3.8-27B-DFlash2

z-lab · Kit

A draft model that speeds up Qwen3.8-27B by proposing a block of tokens for the main model to check. Not standalone. For people serving Qwen3.8-27B with SGLang…

Qwen3.8-Flash-Next-DFlash2

incoai · Kit

Speeds up Qwen3.8-Flash-Next by drafting several tokens at once for the main model to check, for engineers who serve that model with SGLang and want faster out…

Qwen3.8-27B-DSpine-b16-GGUF

aj9o9 · Kit

A GGUF draft model that speeds up Qwen3.8-27B in llama.cpp through speculative decoding, reaching about 125 tokens per second on code and math on one RTX 3090.…

DSpine for Qwen3.8-27B

tencent · Kit

A five-layer draft model that guesses 16 tokens in parallel for Qwen3.8-27B, so the large model can check them together. Made for teams that serve that model.