Qwen3.8-Whittle-MoE-27B-MLX-4bit
barozp · Kit
A 4-bit MLX build for Apple Silicon of a mixture-of-experts model carved from the dense Qwen3.8-27B, with 17.8B active of 27B total parameters. For people who…
New
AI projects from Hugging Face
Categories and filters
Listings
Runs a pruned, 2-bit DeepSeek-V4.1-Flash on a 128 GB Mac through mlx-serve, keeping 192 of 384 experts and a 1M-token context. Strongest on code, reasoning and…
New
GLM-5.3-Flash-Coder-RCO-152E-GGUF
lapadatbogdan · Kit
Runs a pruned GLM-5.3-Flash coding and agent model on a home PC, as GGUF files in five quant sizes. It keeps 152 of 288 experts per layer, cutting a 321B model…
New
Qwen3.8-Flash-Next-GSQ-RCO-Coder-GGUF
ISTA-DASLab · Kit
A coding-focused GGUF build of Qwen3.8-Flash-Next with half its experts removed, cutting 354 GB at BF16 to 58.4 GB while keeping image input. For people with l…
New
DeepSeek-V4.1-Flash-1017-GSQ-RCO-Coder-GGUF
ISTA-DASLab · Kit
An expert pruned and quantized GGUF of DeepSeek-V4.1-Flash-1017 from ISTA-DASLab, aimed at code and agent work, with transformer weights of 72.1 GB. Suits deve…
New