AI projects from Hugging Face

Qwen3.8-27B-Quark-AWQ-MXFP4

amd · Kit

Runs Qwen3.8-27B as a smaller MXFP4-quantized copy made with AMD Quark and AWQ, served through vLLM. Made for developers who want a compressed 27B vision-langu…

Qwen3.5-35B-A3B-GGUF

unsloth · Kit

Reads text and images, writes code and calls tools on your own machine, as Unsloth's refreshed GGUF files for the Qwen3.5 35B-A3B vision-language model. For de…

DSpine

tencent · Kit

Drafts several tokens at once for speculative decoding with Qwen3-8B, so a model server can check them in one pass. For inference engineers and speculative dec…

Qwen3.8-27B Agention Precision GGUF

agentionai · Kit

Packs Qwen3.8-27B as llama.cpp GGUF files in eight sizes from 8.95 to 16.35 GiB, plus a vision projector. The author reports less drift from the BF16 model tha…

Occamy-1.0

Accio-Lab · Kit

An open 35B image and text model from Accio-Lab, based on Qwen3.6-35B-A3B, in BF16, GGUF, FP8, NVFP4 and MLX formats. For teams that serve a large model.

Qwen3.8-Flash-Next-125B-UltraLite-37GiB-GGUF

0xKitkat · Kit

Squeezes the Qwen3.8-Flash-Next mixture-of-experts model into about 37 GiB of text-only GGUF files for experiments. It needs a patched llama.cpp build that com…

Laplace-1-Atlas

JuneoAI · Kit

Helps organizations decide who does a task, who sees information, what runs and what gets accepted, by scoring candidate options in one pass. A 27.4B model bui…

VideoJev-4B

ZhuYuhan · Kit

Finds when an event happens in a video and answers multiple-choice questions about it, by scoring candidates directly. Built on Qwen3.5-4B for video researcher…

OpenBonsai Qwen3.5-9B Ternary

webbrain-one · Kit

Runs Qwen3.5-9B squeezed to ternary weights in a roughly 2 GB GGUF file, for CPU use in two llama.cpp variants. A research preview for people who experiment wi…

Qwen3.6-27B-MTP-GGUF

unsloth · Kit

Codes and reasons with Qwen3.6 27B in GGUF files by Unsloth that carry multi-token prediction, which the card says speeds up replies about 1.5 to 2 times with…

Qwen3.5-0.8B-MTP-GGUF

unsloth · Kit

Runs the small Qwen3.5 0.8B vision-language model in llama.cpp with multi-token prediction for faster generation, as Unsloth's GGUF files. For developers testi…

NeoHorse-1-9B

TokenRhythm · Kit

A 9B text model post-trained from Qwen3.5-9B for agent frameworks, tool use, coding and instruction following, released as text-only weights. For developers wh…

GameScaling

THUSI-Lab · Kit

A small vision-language model built on Qwen3.5-0.8B from a research project on continued pre-training for embodied agents in many virtual game worlds. For rese…

MNN-Pocket-0.3B-Base

taobao-mnn · Kit

A pre-trained base language model of about 300M parameters for Chinese and English, designed with the MNN inference engine for on-device use, as a start for fu…

Bielik-11B-v3.1-DFlash2

speakleash · Kit

Pairs with the Bielik-11B-v3.1-Instruct model as a draft model for speculative decoding in SGLang or vLLM. It is not a standalone language model.

Bielik-11B-v3.1-DFlash

speakleash · Kit

Serves as the DFlash draft model that pairs with Bielik-11B-v3.1-Instruct for speculative decoding in SGLang or vLLM. It is not a standalone language model. Fo…

Kimi-K3.1-Dflash2-Preview

RadixArk · Kit

Speeds up Kimi-K3.1-Pro serving by drafting blocks of tokens that the main model checks in one pass. A draft model for SGLang users, used alongside the target…

Qwen3Guard-Stream-0.6B

Qwen · Kit

Checks text for safety token by token while a language model is still writing, rating each part safe, controversial or unsafe in 119 languages and dialects. Su…

Qwen3Guard-Gen-0.6B

Qwen · Kit

A small safety moderation model that labels a prompt or a model reply as safe, controversial or unsafe and names the risk categories, in 119 languages. Suits d…

Qwen3-Embedding-0.6B-GGUF

Qwen · Kit

Turns text into number vectors for search, retrieval and clustering in more than 100 languages, as a 0.6B model in GGUF format. Suits developers building searc…