Qwen3.8-27B-DFlash2-GGUF by z-lab
z-lab · Kit
A draft model in GGUF form that speeds up Qwen3.8-27B by proposing token blocks for the main model to verify. For people who run that model locally with llama.…
New
AI projects from Hugging Face
Categories and filters
Listings
Ornith-1.5-122B-NVFP4-DFlash2-RTX-Spark
Sherlock-Comms · Kit
Serves the 122B Ornith 1.5 model through vLLM with DFlash2 speculative decoding, using an unquantized output head. Made for RTX Spark laptops with 128 GB of me…
New
Qwen3.8-Flash-Next-DFlash2-GGUF
nazeshinjite · Kit
GGUF draft model that speeds up Qwen3.8-Flash-Next in llama.cpp through speculative decoding, in 334 MiB and 622 MiB files. It is not a standalone model, and i…
New
Flint-DFlash2
incoai · Kit
A 403M-parameter draft model that speeds up serving of the Flint language model with speculative decoding in SGLang, without changing its output. It is not a s…
New
Bielik-11B-v3.1-DFlash2
speakleash · Kit
Pairs with the Bielik-11B-v3.1-Instruct model as a draft model for speculative decoding in SGLang or vLLM. It is not a standalone language model.
New
Bielik-11B-v3.1-DFlash
speakleash · Kit
Serves as the DFlash draft model that pairs with Bielik-11B-v3.1-Instruct for speculative decoding in SGLang or vLLM. It is not a standalone language model. Fo…
New
Kimi-K3.1-Dflash2-Preview
RadixArk · Kit
Speeds up Kimi-K3.1-Pro serving by drafting blocks of tokens that the main model checks in one pass. A draft model for SGLang users, used alongside the target…
New
Qwen3.8-27B-DFlash2 by incoai
incoai · Kit
Speeds up Qwen3.8-27B by drafting blocks of tokens that the main model then checks, with output unchanged. A 1.9B draft model for SGLang and vLLM servers, not…
New
Qwen3.8-27B-Splash
incoai · Kit
Serves Qwen3.8-27B on Apple silicon Macs through Inco AI's Splash engine, with a 4-bit model, a DFlash 2 draft and a vision encoder in one package. Works only…
New
Qwen3.8-27B-DFlash2
z-lab · Kit
A draft model that speeds up Qwen3.8-27B by proposing a block of tokens for the main model to check. Not standalone. For people serving Qwen3.8-27B with SGLang…
New
Qwen3.8-Flash-Next-DFlash2
incoai · Kit
Speeds up Qwen3.8-Flash-Next by drafting several tokens at once for the main model to check, for engineers who serve that model with SGLang and want faster out…
New
Qwen3.8-27B GGUF (ShapeLearn Quantized)
byteshape · Kit
Runs Qwen3.8-27B as GGUF files quantized by ByteShape's ShapeLearn, in five GPU-sized options with vision input and MTP speculative decoding in llama.cpp. For…
New
Qwen3.8-27B-DSpine-b16-GGUF
aj9o9 · Kit
A GGUF draft model that speeds up Qwen3.8-27B in llama.cpp through speculative decoding, reaching about 125 tokens per second on code and math on one RTX 3090.…
New