Spark-X2.6-4B-DSpark-GGUF
XHToken · Kit
Speeds up text generation for Spark-X2.6-4B as a small draft model for speculative decoding, in GGUF format. Meant for people running that model locally with l…
New
AI projects from Hugging Face
Categories and filters
Listings
Qwen3.8-27B IQR-V4
StillDeadcode · Kit
Qwen3.8-27B compressed to fifteen sizes from about 2.5 to 8 bits per weight, for the radiance engine on AMD RDNA4 GPUs, with image reading and a speed-up draft…
New
MedErtas v0.1 27B LS
ErtasAI · Kit
Open-weight medical language model squeezed to 22 GB, best at clinical calculations and facts from long patient records. For teams building medical AI products…
New
Qwen3.8-27B-pi
bytkim · Kit
A 27B coding model tuned for the Pi agent framework, trained to read a repository, edit files, run tools and use their feedback, with adjustable reasoning effo…
New
Qwen3.8-27B-DFlash2
z-lab · Kit
A draft model that speeds up Qwen3.8-27B by proposing a block of tokens for the main model to check. Not standalone. For people serving Qwen3.8-27B with SGLang…
New
Qwen3.8-Flash-Next-DFlash2
incoai · Kit
Speeds up Qwen3.8-Flash-Next by drafting several tokens at once for the main model to check, for engineers who serve that model with SGLang and want faster out…
New
Qwen3.8-27B-DSpine-b16-GGUF
aj9o9 · Kit
A GGUF draft model that speeds up Qwen3.8-27B in llama.cpp through speculative decoding, reaching about 125 tokens per second on code and math on one RTX 3090.…
New
mini-infer
prajwalpujari16 · Kit
A browser studio that simulates GPU PagedAttention block allocation, prefix caching, speculative decoding checks and KV-cache sizing. For engineers and student…
New
DSpine for Qwen3.8-27B
tencent · Kit
A five-layer draft model that guesses 16 tokens in parallel for Qwen3.8-27B, so the large model can check them together. Made for teams that serve that model.
New