AI projects from Hugging Face

Qwen3.6-35B-A3B-NVFP4-Fast

unsloth · Kit

Serves Qwen3.6 35B A3B in a fast NVFP4 build by Unsloth for vLLM on NVIDIA GPUs. The card says it has 1.79x the throughput of other NVFP4 builds and fits a 32…

Ornith-1.5-122B-NVFP4-DFlash2-RTX-Spark

Sherlock-Comms · Kit

Serves the 122B Ornith 1.5 model through vLLM with DFlash2 speculative decoding, using an unquantized output head. Made for RTX Spark laptops with 128 GB of me…

Qwen3.8-27B-QUASAR-NVFP4

QUASAR-QAT · Kit

Runs Qwen3.8-27B in 4-bit NVFP4 at 19.7 GB, trained with the QUASAR method to stay close to the full BF16 model. For people serving it with vLLM on an NVIDIA B…

DeepSeek-V4.1-Flash-1017-EXL3-franken-v100

philbert440 · Kit

Runs DeepSeek V4.1 Flash at its full 1M-token context on eight Tesla V100 32 GB cards, using an EXL3 expert pack and an SM70 vLLM build. For owners of such ser…

Limite 1B - Violetto

paradigma-inc · Kit

Solves hard math problems with a 1B-parameter model trained from scratch for fast, high-volume reasoning. It suits developers who run math workloads on an NVID…

Leanstral 1.5 119B A6B

mistralai · Kit

An open code-agent model from Mistral for the Lean 4 proof assistant. It proves theorems and fixes Lean code, takes text and images, and runs through the Mistr…

Qwen3.8-27B-NVFP4 Deployment Edition

IteraCompute · Kit

Serves Qwen3.8-27B in NVFP4 on one RTX 5090 with vLLM, with a checksum-verified download, FP8 KV cache, tool calls and reasoning support. For developers self-h…

Qwen3.6-35B-A3B-2Bit-GSQ

ISTA-DASLab · Kit

A 2-bit quantized copy of Qwen3.6-35B-A3B made with GSQ, a Gumbel-Softmax method, that keeps most reasoning and coding ability at a much smaller memory footpri…

KVARK Sparkle 1.0 (27B) FP8

Egzakta · Kit

Runs a 27B model that reads images and text, in FP8 for vLLM. It reasons with far fewer tokens than a Qwen model of the same size. Made for people who host the…

ARK-ASR-3B

Edge0 · Kit

Turns speech into text in many languages, with a Whisper-style audio encoder feeding a Qwen decoder. For developers and researchers who want multilingual trans…

Qwen3.8-27B-NVFP4-DGX-SPARK

autotrust · Kit

Speeds up Qwen3.8-27B NVFP4 decoding about 3.9 times on a DGX Spark, using the same weights and a tuned speculative-decoding setup. For teams serving it with v…

OvisOCR2

ATH-MaaS · Kit

Document parsing model that reads a page image and writes Markdown in reading order, covering text, formulas and tables. About 0.8B parameters, run through vLL…

Qwen3.8-27B-Quark-AWQ-MXFP4

amd · Kit

Runs Qwen3.8-27B as a smaller MXFP4-quantized copy made with AMD Quark and AWQ, served through vLLM. Made for developers who want a compressed 27B vision-langu…

MiMo-V2.6-Flash-RL-NVFP4

primitive-ai · Kit

Serves Xiaomi's MiMo-V2.6-Flash-RL as an NVFP4 build for Blackwell GPUs, with the release's exact expert values and more throughput on two 96 GB cards. For peo…

GLM-5.3-Flash EXL3 3.05bpw

albucino · Kit

Runs GLM-5.3-Flash locally on two RTX 3090 cards with 128 GB of RAM and a 262,144-token context, using a verified 3.05 bpw EXL3 quantization. For people hostin…

DuplexJev-4B-Para

adventists-ai · Kit

Takes speech and text in, answers in text, and judges when a speaker has finished talking. Built for voice-agent developers who want a small audio model that a…

Bielik-11B-v3.1-DFlash2

speakleash · Kit

Pairs with the Bielik-11B-v3.1-Instruct model as a draft model for speculative decoding in SGLang or vLLM. It is not a standalone language model.

Bielik-11B-v3.1-DFlash

speakleash · Kit

Serves as the DFlash draft model that pairs with Bielik-11B-v3.1-Instruct for speculative decoding in SGLang or vLLM. It is not a standalone language model. Fo…

Laguna XS 2.1

poolside · Kit

Writes code and works through long coding tasks with tool calls, using a 33B mixture-of-experts model that activates 3B parameters per token. For developers wh…

gpt-oss-safeguard-20b

openai · Kit

Classifies text against a safety policy you write and shows its reasoning. For trust and safety teams filtering model inputs and outputs, labeling content onli…