DSpine
tencent · Kit
Drafts several tokens at once for speculative decoding with Qwen3-8B, so a model server can check them in one pass. For inference engineers and speculative dec…
New
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
tencent · Kit
Drafts several tokens at once for speculative decoding with Qwen3-8B, so a model server can check them in one pass. For inference engineers and speculative dec…
aj9o9 · Kit
A GGUF draft model that speeds up Qwen3.8-27B in llama.cpp through speculative decoding, reaching about 125 tokens per second on code and math on one RTX 3090.…
tencent · Kit
A five-layer draft model that guesses 16 tokens in parallel for Qwen3.8-27B, so the large model can check them together. Made for teams that serve that model.