AI skills and agents for developers

Qwen3.6-35B-A3B-NVFP4-Fast

unsloth · Kit

Serves Qwen3.6 35B A3B in a fast NVFP4 build by Unsloth for vLLM on NVIDIA GPUs. The card says it has 1.79x the throughput of other NVFP4 builds and fits a 32…

Ornith-1.5-122B-NVFP4-DFlash2-RTX-Spark

Sherlock-Comms · Kit

Serves the 122B Ornith 1.5 model through vLLM with DFlash2 speculative decoding, using an unquantized output head. Made for RTX Spark laptops with 128 GB of me…

Qwen3.8-27B-QUASAR-NVFP4

QUASAR-QAT · Kit

Runs Qwen3.8-27B in 4-bit NVFP4 at 19.7 GB, trained with the QUASAR method to stay close to the full BF16 model. For people serving it with vLLM on an NVIDIA B…

DeepSeek-V4.1-Flash-1017-EXL3-franken-v100

philbert440 · Kit

Runs DeepSeek V4.1 Flash at its full 1M-token context on eight Tesla V100 32 GB cards, using an EXL3 expert pack and an SM70 vLLM build. For owners of such ser…

Leanstral 1.5 119B A6B

mistralai · Kit

An open code-agent model from Mistral for the Lean 4 proof assistant. It proves theorems and fixes Lean code, takes text and images, and runs through the Mistr…

Qwen3.8-27B-NVFP4 Deployment Edition

IteraCompute · Kit

Serves Qwen3.8-27B in NVFP4 on one RTX 5090 with vLLM, with a checksum-verified download, FP8 KV cache, tool calls and reasoning support. For developers self-h…

Qwen3.6-35B-A3B-2Bit-GSQ

ISTA-DASLab · Kit

A 2-bit quantized copy of Qwen3.6-35B-A3B made with GSQ, a Gumbel-Softmax method, that keeps most reasoning and coding ability at a much smaller memory footpri…

KVARK Sparkle 1.0 (27B) FP8

Egzakta · Kit

Runs a 27B model that reads images and text, in FP8 for vLLM. It reasons with far fewer tokens than a Qwen model of the same size. Made for people who host the…

Qwen3.8-27B-NVFP4-DGX-SPARK

autotrust · Kit

Speeds up Qwen3.8-27B NVFP4 decoding about 3.9 times on a DGX Spark, using the same weights and a tuned speculative-decoding setup. For teams serving it with v…

OvisOCR2

ATH-MaaS · Kit

Document parsing model that reads a page image and writes Markdown in reading order, covering text, formulas and tables. About 0.8B parameters, run through vLL…

Qwen3.8-27B-Quark-AWQ-MXFP4

amd · Kit

Runs Qwen3.8-27B as a smaller MXFP4-quantized copy made with AMD Quark and AWQ, served through vLLM. Made for developers who want a compressed 27B vision-langu…

Bielik-11B-v3.1-DFlash2

speakleash · Kit

Pairs with the Bielik-11B-v3.1-Instruct model as a draft model for speculative decoding in SGLang or vLLM. It is not a standalone language model.

Bielik-11B-v3.1-DFlash

speakleash · Kit

Serves as the DFlash draft model that pairs with Bielik-11B-v3.1-Instruct for speculative decoding in SGLang or vLLM. It is not a standalone language model. Fo…

Comet 60B

MultiverseComputingCAI · Kit

A 61.1B multimodal model from Multiverse Computing, a compressed version of NVIDIA's Nemotron 3.5 Super that takes text, image and video and keeps about 12B pa…

KAT-Coder-V2.5-Dev

Kwaipilot · Kit

An open-weight coding model from Kwaipilot, a mixture-of-experts with 35B total and 3B active parameters, tuned for agentic coding and fewer tool-call glitches…

Qwen3.8-27B-DFlash2 by incoai

incoai · Kit

Speeds up Qwen3.8-27B by drafting blocks of tokens that the main model then checks, with output unchanged. A 1.9B draft model for SGLang and vLLM servers, not…

MedErtas v0.1 31B LS

ErtasAI · Kit

Serves a medical-domain language model, a compressed Gemma 4 31B, on vLLM and NVIDIA Blackwell GPUs. Built for medical AI products that need fast, low-cost ans…

Qwen3.8-27B-AWQ-INT4

cyankiwi · Kit

A 4-bit AWQ quantization of Qwen3.8-27B by cyankiwi, a 27B vision-language model with thinking control. Weights are 21.02 GB and load in Transformers, vLLM or…

Ling-3.1-flash-1019

inclusionAI · Kit

Handles scientific and agentic tasks with 560B total and 25B active parameters and a 1M-token context, tuned further from Ling-3.1-flash. Serving examples use…

Qwen3.8-27B-Randean-MXFP4

flechin · Kit

A 27B reasoning model tuned to answer plainly instead of hedging, quantized to MXFP4 so vLLM can serve it on a single 32 GB GPU, for developers who run local r…

Qwen3.5-35B-A3B

Qwen · Kit

A multimodal chat model that reads images and text, with 35B parameters of which 3B are active at a time. For developers who host their own large model with Tr…

Qwen3.8-27B-DFlash2

z-lab · Kit

A draft model that speeds up Qwen3.8-27B by proposing a block of tokens for the main model to check. Not standalone. For people serving Qwen3.8-27B with SGLang…

d3-ultra

vllm-sr · Kit

Answers many questions about one text, image or video input at once, with a probability for each answer and no generated text. A 27B multimodal decision model…

Qwen3.6-35B-A3B-NVFP4

nvidia · Kit

A pre-quantized NVFP4 copy of Alibaba's Qwen3.6-35B-A3B, made by NVIDIA with Model Optimizer. It takes text, images and video, and runs on vLLM with Hopper or…

GLM-5.3-Flash-NVFP4

nvidia · Kit

Gives you NVIDIA's NVFP4 quantized copy of ZAI's GLM-5.3-Flash, a multimodal model for reasoning, coding and agent tasks. Meant for developers who deploy on Bl…

Qwen3.5-0.8B Astra Weight Edit

JonathanColetti · Kit

Fixes the repeat loops that Qwen3.5-0.8B falls into in thinking mode by editing two weight tensors directly, with no training. A small image-text model for Tra…

DeepSeek-V4.1-Flash-EXL3-3bpw-2x-RTX-PRO-6000

diffbot · Kit

Serves a 3-bit compressed copy of DeepSeek-V4.1-Flash-1017 on two 96 GB RTX PRO 6000 Blackwell cards with vLLM, for developers who host a large coding and agen…

Qwen3.8-27B-NVFP4

unsloth · Kit

A 4-bit NVFP4 copy of the Qwen3.8 27B vision-language model made by Unsloth, for serving with vLLM. For developers who want a dense model that reads images and…

hs-decide-1-flash

hindsight-ai · Kit

Answers typed questions about a text state with a probability for every option in one pass, with no generated text, in eight languages. A 0.8B decision model f…

Qwen3.8-27B-FP8

Qwen · Kit

Handles text, images and video with FP8-quantized weights of Qwen3.8-27B, a 27B dense model with adjustable thinking. For developers serving it with transforme…

Qwen3.5-4B

Qwen · Kit

Handles text and image input with a 4B hybrid model that supports 201 languages and dialects and a 262,144-token context. For developers running small open wei…

Qwen3.6-35B-A3B

Qwen · Kit

Helps with coding, repository-level reasoning and image-plus-text input using a 35B mixture-of-experts model that activates 3B parameters. For developers runni…

S5-nano

maritaca-ai · Kit

Maritaca AI's small Portuguese and English model built on Qwen3.5-4B, with Think and Instruct modes and strong tool use, in BF16 for vLLM and SGLang. Suits dev…

VibeVoice

microsoft · Kit

Microsoft’s open-source family of voice AI models. VibeVoice-ASR transcribes up to 60 minutes of audio in one pass, with speakers and timestamps. VibeVoice-Rea…

MiniCPM-V

OpenBMB · Kit

OpenBMB’s open multimodal models: MiniCPM-V 4.7 reads images, documents and video, and MiniCPM-o 4.5 also hears and speaks. The setup notes cover Transformers,…