Spark-X2.6-4B-FP8
XHToken · Kit
Compact 4.1B-parameter text model in FP8 form for on-device use, with three thinking levels (none, low, high) and English and Chinese support. Aimed at coding…
XHToken · Kit
Compact 4.1B-parameter text model in FP8 form for on-device use, with three thinking levels (none, low, high) and English and Chinese support. Aimed at coding…
unsloth · Kit
Serves Qwen3.6 35B A3B in a fast NVFP4 build by Unsloth for vLLM on NVIDIA GPUs. The card says it has 1.79x the throughput of other NVFP4 builds and fits a 32…
Nanbeige · Kit
INT4 quantized version of Nanbeige4.3-33B, a 33B model for coding and professional agent tasks, made with quantization-aware training. For developers who want…
ISTA-DASLab · Kit
A 2-bit quantized copy of Qwen3.6-35B-A3B made with GSQ, a Gumbel-Softmax method, that keeps most reasoning and coding ability at a much smaller memory footpri…
ErtasAI · Kit
Serves a medical-domain language model, a compressed Gemma 4 31B, on vLLM and NVIDIA Blackwell GPUs. Built for medical AI products that need fast, low-cost ans…
cyankiwi · Kit
A 4-bit AWQ quantization of Qwen3.8-27B by cyankiwi, a 27B vision-language model with thinking control. Weights are 21.02 GB and load in Transformers, vLLM or…
unsloth · Kit
A 4-bit NVFP4 copy of the Qwen3.8 27B vision-language model made by Unsloth, for serving with vLLM. For developers who want a dense model that reads images and…