Qwen3.8-27B-NVFP4 by RadixArk
RadixArk · Kit
A pre-quantized NVFP4 copy of Qwen3.8-27B that reads text, images and video and answers in text, served with SGLang on NVIDIA Blackwell GPUs. Suits developers…
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
RadixArk · Kit
A pre-quantized NVFP4 copy of Qwen3.8-27B that reads text, images and video and answers in text, served with SGLang on NVIDIA Blackwell GPUs. Suits developers…
incoai · Kit
A 403M-parameter draft model that speeds up serving of the Flint language model with speculative decoding in SGLang, without changing its output. It is not a s…
speakleash · Kit
Pairs with the Bielik-11B-v3.1-Instruct model as a draft model for speculative decoding in SGLang or vLLM. It is not a standalone language model.
speakleash · Kit
Serves as the DFlash draft model that pairs with Bielik-11B-v3.1-Instruct for speculative decoding in SGLang or vLLM. It is not a standalone language model. Fo…
RadixArk · Kit
Speeds up Kimi-K3.1-Pro serving by drafting blocks of tokens that the main model checks in one pass. A draft model for SGLang users, used alongside the target…
Kwaipilot · Kit
An open-weight coding model from Kwaipilot, a mixture-of-experts with 35B total and 3B active parameters, tuned for agentic coding and fewer tool-call glitches…
incoai · Kit
Speeds up Qwen3.8-27B by drafting blocks of tokens that the main model then checks, with output unchanged. A 1.9B draft model for SGLang and vLLM servers, not…
cyankiwi · Kit
A 4-bit AWQ quantization of Qwen3.8-27B by cyankiwi, a 27B vision-language model with thinking control. Weights are 21.02 GB and load in Transformers, vLLM or…
AQ-MedAI · Kit
A small draft model that speeds up Ling-3.1-Flash with speculative decoding in SGLang, drafting 5 or 7 tokens at a time. For teams serving Ling-3.1-Flash on NV…
inclusionAI · Kit
Handles scientific and agentic tasks with 560B total and 25B active parameters and a 1M-token context, tuned further from Ling-3.1-flash. Serving examples use…
inclusionAI · Kit
Handles complex agent, search, office and coding work with 560B total and 25B active parameters and a 1M-token context. Serving examples use SGLang on multi-GP…
z-lab · Kit
A draft model that speeds up Qwen3.8-27B by proposing a block of tokens for the main model to check. Not standalone. For people serving Qwen3.8-27B with SGLang…
nvidia · Kit
Gives you NVIDIA's NVFP4 quantized copy of ZAI's GLM-5.3-Flash, a multimodal model for reasoning, coding and agent tasks. Meant for developers who deploy on Bl…
incoai · Kit
Speeds up Qwen3.8-Flash-Next by drafting several tokens at once for the main model to check, for engineers who serve that model with SGLang and want faster out…
Qwen · Kit
Handles text, images and video with FP8-quantized weights of Qwen3.8-27B, a 27B dense model with adjustable thinking. For developers serving it with transforme…
Qwen · Kit
Handles text and image input with a 4B hybrid model that supports 201 languages and dialects and a 262,144-token context. For developers running small open wei…
Qwen · Kit
Helps with coding, repository-level reasoning and image-plus-text input using a 35B mixture-of-experts model that activates 3B parameters. For developers runni…
baidu · Kit
Baidu's 3.3B document parsing model for long documents, using SR-SWA attention to keep decoding cost nearly flat, with Transformers and SGLang routes. Suits te…
maritaca-ai · Kit
Maritaca AI's small Portuguese and English model built on Qwen3.5-4B, with Think and Instruct modes and strong tool use, in BF16 for vLLM and SGLang. Suits dev…
OpenBMB · Kit
OpenBMB’s open multimodal models: MiniCPM-V 4.7 reads images, documents and video, and MiniCPM-o 4.5 also hears and speaks. The setup notes cover Transformers,…