AI projects from Hugging Face

Qwen3.8-27B-DFlash2-GGUF by z-lab

z-lab · Kit

A draft model in GGUF form that speeds up Qwen3.8-27B by proposing token blocks for the main model to verify. For people who run that model locally with llama.…

Clef-LoRA-for-Qwen3.8-27B-GGUF

trevest · Kit

Adds Cloudflare Clef's decision head to a Qwen3.8-27B chat model, so one llama.cpp server on a 24 GB GPU both answers typed questions and chats. It is a LoRA a…

Ornith-1.5-122B-NVFP4-DFlash2-RTX-Spark

Sherlock-Comms · Kit

Serves the 122B Ornith 1.5 model through vLLM with DFlash2 speculative decoding, using an unquantized output head. Made for RTX Spark laptops with 128 GB of me…

DeepSeek-V4.1-Flash-1017-EXL3-franken-v100

philbert440 · Kit

Runs DeepSeek V4.1 Flash at its full 1M-token context on eight Tesla V100 32 GB cards, using an EXL3 expert pack and an SM70 vLLM build. For owners of such ser…

MiniCPM-OCR 1.0 DSpark

openbmb · Kit

Speeds up MiniCPM-OCR 1.0 by drafting tokens that the main model checks in one pass. A draft head, not a standalone OCR model, for people who self-host documen…

Qwen3.8-Flash-Next-DFlash2-GGUF

nazeshinjite · Kit

GGUF draft model that speeds up Qwen3.8-Flash-Next in llama.cpp through speculative decoding, in 334 MiB and 622 MiB files. It is not a standalone model, and i…

Flint-DFlash2

incoai · Kit

A 403M-parameter draft model that speeds up serving of the Flint language model with speculative decoding in SGLang, without changing its output. It is not a s…

Qwen3.8-27B Splash 8-bit

dmeight · Kit

Runs Qwen3.8-27B at 8-bit through the Splash runtime in LM Studio on Apple silicon. An unofficial package that keeps the model closer to the original than the…

Qwen3.8-27B-NVFP4-DGX-SPARK

autotrust · Kit

Speeds up Qwen3.8-27B NVFP4 decoding about 3.9 times on a DGX Spark, using the same weights and a tuned speculative-decoding setup. For teams serving it with v…

Bielik-11B-v3.1-DFlash2

speakleash · Kit

Pairs with the Bielik-11B-v3.1-Instruct model as a draft model for speculative decoding in SGLang or vLLM. It is not a standalone language model.

Bielik-11B-v3.1-DFlash

speakleash · Kit

Serves as the DFlash draft model that pairs with Bielik-11B-v3.1-Instruct for speculative decoding in SGLang or vLLM. It is not a standalone language model. Fo…

Kimi-K3.1-Dflash2-Preview

RadixArk · Kit

Speeds up Kimi-K3.1-Pro serving by drafting blocks of tokens that the main model checks in one pass. A draft model for SGLang users, used alongside the target…

MiniCPM-V-4.7-1B-gguf

openbmb · Kit

Runs a 1B vision-language model through llama.cpp, answering text prompts about images. GGUF files in many quant sizes, for developers and hobbyists who want a…

Qwen3.8-27B-DFlash2 by incoai

incoai · Kit

Speeds up Qwen3.8-27B by drafting blocks of tokens that the main model then checks, with output unchanged. A 1.9B draft model for SGLang and vLLM servers, not…

Qwen3.8-27B Intel Arc Tuned

Greatjedi · Kit

Runs a 27B Qwen3.8 model in GGUF files retuned for Intel Arc GPUs, with pure decode near 22 tokens a second in the author's tests. For people running llama.cpp…

MedErtas v0.1 31B LS

ErtasAI · Kit

Serves a medical-domain language model, a compressed Gemma 4 31B, on vLLM and NVIDIA Blackwell GPUs. Built for medical AI products that need fast, low-cost ans…

Kvark-Sparkle-1.0-27B-GGUF

Egzakta · Kit

GGUF files of KVARK Sparkle 1.0, a 27B vision-language model, for llama.cpp, Ollama and LM Studio, with the speculative-decoding head kept. For people running…

Spark-X2.6-1.7B-DSpark-GGUF

XHToken · Kit

A small draft model that speeds up Spark-X2.6-1.7B through speculative decoding, guessing up to seven tokens per step. For people who run that model locally on…

Mellum2.1-12B-A2.5B-Thinking-GGUF

JetBrains · Kit

Runs JetBrains' 12B reasoning model locally in llama.cpp, Ollama or LM Studio, with five GGUF sizes to pick from. For developers who want a thinking model with…

Qwen3.8-27B-Splash

incoai · Kit

Serves Qwen3.8-27B on Apple silicon Macs through Inco AI's Splash engine, with a 4-bit model, a DFlash 2 draft and a vision encoder in one package. Works only…

Spark-X2.6-4B-DSpark-GGUF

XHToken · Kit

Speeds up text generation for Spark-X2.6-4B as a small draft model for speculative decoding, in GGUF format. Meant for people running that model locally with l…

Qwen3.8-27B IQR-V4

StillDeadcode · Kit

Qwen3.8-27B compressed to fifteen sizes from about 2.5 to 8 bits per weight, for the radiance engine on AMD RDNA4 GPUs, with image reading and a speed-up draft…

MedErtas v0.1 27B LS

ErtasAI · Kit

Open-weight medical language model squeezed to 22 GB, best at clinical calculations and facts from long patient records. For teams building medical AI products…

Qwen3.8-27B-pi

bytkim · Kit

A 27B coding model tuned for the Pi agent framework, trained to read a repository, edit files, run tools and use their feedback, with adjustable reasoning effo…

Qwen3.8-27B-DFlash2

z-lab · Kit

A draft model that speeds up Qwen3.8-27B by proposing a block of tokens for the main model to check. Not standalone. For people serving Qwen3.8-27B with SGLang…

Qwen3.8-Flash-Next-DFlash2

incoai · Kit

Speeds up Qwen3.8-Flash-Next by drafting several tokens at once for the main model to check, for engineers who serve that model with SGLang and want faster out…

Qwen3.8-27B-DSpine-b16-GGUF

aj9o9 · Kit

A GGUF draft model that speeds up Qwen3.8-27B in llama.cpp through speculative decoding, reaching about 125 tokens per second on code and math on one RTX 3090.…

mini-infer

prajwalpujari16 · Kit

A browser studio that simulates GPU PagedAttention block allocation, prefix caching, speculative decoding checks and KV-cache sizing. For engineers and student…

DSpine for Qwen3.8-27B

tencent · Kit

A five-layer draft model that guesses 16 tokens in parallel for Qwen3.8-27B, so the large model can check them together. Made for teams that serve that model.