AI projects from Hugging Face

Qwen3.8-27B-QUASAR-NVFP4

QUASAR-QAT · Kit

Runs Qwen3.8-27B in 4-bit NVFP4 at 19.7 GB, trained with the QUASAR method to stay close to the full BF16 model. For people serving it with vLLM on an NVIDIA B…

Qwen3.6-35B-A3B-4bit

mlx-community · Kit

A 4-bit MLX conversion of Qwen3.6-35B-A3B that answers text and image prompts on Apple Silicon Macs. Made for people who want to run this Qwen model locally wi…

JevK5-chat-mlx-4bit

mlx-community · Kit

A 4-bit MLX copy of the 4.2B JevK5 chat model for Apple Silicon, with a 262,144 token context and a small memory footprint. Made for Mac users who want a quick…

flint-mixed-3-4bit

mlx-community · Kit

A community MLX build of Recursive's 40B Flint coding model that shrinks the experts to 3 bits, so it fits a 24 GB or 32 GB Apple Silicon Mac. Made for develop…

clef-flash-4bit

mlx-community · Kit

A 4-bit MLX copy of Cloudflare's clef-flash that turns a state and typed questions into a probability for every allowed answer on Apple Silicon Macs. Not a cha…

Underdog-Woof-4B-1.1

ConwayResearch · Kit

Generates text as a compact 4.2B model, post-trained from Qwen 3 4B to work better with Underdog's own setup and quantized to 4-bit for MLX. For people running…

Qwen3.8-Whittle-MoE-27B-MLX-4bit

barozp · Kit

A 4-bit MLX build for Apple Silicon of a mixture-of-experts model carved from the dense Qwen3.8-27B, with 17.8B active of 27B total parameters. For people who…

Qwen3.5-9B-OptiQ-4bit

mlx-community · Kit

A 4-bit mixed-precision MLX version of Qwen3.5-9B for local text generation on Apple Silicon, with a bundled multi-token prediction head. For Mac users who run…

Qwen3.8-27B-4bit (MLX)

mlx-community · Kit

4-bit MLX conversion of Qwen3.8-27B that reads text and images and answers in text, run with the mlx-vlm tool. For developers who want to run a vision-language…