Qwen3.8-27B-mixed-3.5bpw-MLX
rapid-mlx · Kit
A 27B vision-language model compressed to 3.5 bits per weight for Apple Silicon Macs with 24 GB of memory, served locally through Rapid-MLX. Suits Mac users an…
New
AI projects from Hugging Face
Categories and filters
Listings
DeepSeek-V4.1-Flash-1017-oQ4e-ngram-mtp
mlx-community · Kit
A mixed-precision MLX copy of DeepSeek-V4.1-Flash-1017 that keeps the Engram tables at FP8. Made for people with hundreds of GB of memory who want to run the m…
New
DeepSeek-V4.1-Flash-1017-GSQ-agentic-strata
kaushikvira · Kit
Runs the 763.2B-parameter DeepSeek V4.1 Flash as a 153 GiB mixed-precision build tuned for agentic and coding work on the strata engine. For people with a larg…
New
Qwen3.8-27B-oQ8e-mtp
Jundot · Kit
Runs Qwen3.8-27B as an 8-bit mixed-precision MLX checkpoint with its vision encoder and MTP head, for image and text chat on Apple hardware. For people who wan…
New
Qwen3.8-27B-oQ4e-mtp
Jundot · Kit
Runs the 27B Qwen3.8 vision-language model on MLX in about 17.5 GB, reading text, images and video with a 262,144-token context. A mixed-precision quantization…
New
GLM-5.3-Flash-oQ4e-mtp
Jundot · Kit
A mixed-precision MLX copy of zai-org's GLM-5.3-Flash multimodal mixture-of-experts model, about 4.6 bits per weight, with the vision encoder and multi-token p…
New
GLM-5.3-Flash EXL3 Spark
0xSero · Kit
Runs GLM-5.3-Flash with a 256k-token context and image input on one DGX Spark, using a mixed 2.31 bits-per-weight EXL3 build. For people hosting a large model…
New
Qwen3.5-9B-OptiQ-4bit
mlx-community · Kit
A 4-bit mixed-precision MLX version of Qwen3.5-9B for local text generation on Apple Silicon, with a bundled multi-token prediction head. For Mac users who run…
New
Qwen3.8-27B-SLQ-GGUF
kaitchup · Kit
Compresses Qwen3.8-27B into three GGUF files with different size and fidelity levels, using a custom statistically lossless quantization. For people who run th…
New
Qwen3.8-27B-oQ6e-mtp
Jundot · Kit
A mixed-precision MLX copy of Qwen3.8-27B at about 6.9 bits per weight, with the vision encoder and multi-token prediction head included, for running locally o…
New
Qwen3.6-35B-A3B-oQ6e-mtp
Jundot · Kit
A mixed-precision MLX copy of Qwen3.6-35B-A3B at about 6.8 bits per weight, with the vision encoder and multi-token prediction head included, for running local…
New
Qwen3.8 Flash Next Turbo Brilliance 50x GGUF
DavidAU · Kit
A GGUF build of Qwen3.8-Flash-Next by DavidAU with 27 reasoning modes, 27 instruct modes and 15 AI personas you switch on from the prompt. For people with larg…
New
Qwen3.8-27B iMatrix NVFP4 MTP GGUF
cdiamond · Kit
A 17.1 GB mixed-precision GGUF of Qwen3.8-27B that keeps its multi-token prediction layer, tuned for 256K context with vision on a 24 GB GPU. For people who ru…
New
DeepSeek-V4.1-Flash-1017-oQ4e-mtp
mlx-community · Kit
A mixed-precision MLX copy of DeepSeek-V4.1-Flash-1017, a huge multimodal mixture-of-experts model. Made for people with hundreds of GB of memory who want to r…
New
DeepSeek-V4.1-Flash-1017 TrellisMX K2 Mix
brandonmusic · Kit
A compressed copy of DeepSeek-V4.1-Flash-1017 sized for two 96 GB GPUs, with a few experts stored at higher precision. A research build for people who serve la…
New
Ornith-1.5-35B-A3B-GSQ-RCO-GGUF
pfeifferj · Kit
Shrinks the Ornith-1.5-35B-A3B text model to 3-bit and 3.5-bit GGUF files, about 13 and 15 GB instead of 69 GB, for people who run local models with llama.cpp.
New
DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF
ISTA-DASLab · Kit
GGUF versions of DeepSeek-V4.1-Flash-1017 at three small sizes, with each tensor quantized at its own precision. For people running a huge mixture-of-experts m…
New
Qwen3.8-Flash-Next-GSQ-RCO-Coder-GGUF
ISTA-DASLab · Kit
A coding-focused GGUF build of Qwen3.8-Flash-Next with half its experts removed, cutting 354 GB at BF16 to 58.4 GB while keeping image input. For people with l…
New
Qwen3.8-Flash-Next-GSQ-RCO-GGUF
ISTA-DASLab · Kit
GGUF versions of Qwen3.8-Flash-Next at four sizes, with each tensor quantized at its own precision and a vision projector for image input. For people running a…
New
DeepSeek-V4.1-Flash-1017-GSQ-RCO-Coder-GGUF
ISTA-DASLab · Kit
An expert pruned and quantized GGUF of DeepSeek-V4.1-Flash-1017 from ISTA-DASLab, aimed at code and agent work, with transformer weights of 72.1 GB. Suits deve…
New