JevK5-chat-mlx-4bit
mlx-community · Kit
A 4-bit MLX copy of the 4.2B JevK5 chat model for Apple Silicon, with a 262,144 token context and a small memory footprint. Made for Mac users who want a quick…
New
AI projects from Hugging Face
Categories and filters
Listings
flint-mixed-3-4bit
mlx-community · Kit
A community MLX build of Recursive's 40B Flint coding model that shrinks the experts to 3 bits, so it fits a 24 GB or 32 GB Apple Silicon Mac. Made for develop…
New
clef-flash-4bit
mlx-community · Kit
A 4-bit MLX copy of Cloudflare's clef-flash that turns a state and typed questions into a probability for every allowed answer on Apple Silicon Macs. Not a cha…
New
Muse Glimmer 30B GGUF by meta-models
meta-models · Kit
GGUF builds of a 30-billion-parameter agentic model for llama.cpp, with an optional image encoder and a speculative decoding drafter. They suit people who run…
New
dale-9b (GGUF)
manuelgscom · Kit
Turns a Spanish or English request into one Linux bash command, returned as a small JSON object. For terminal users and developers who want a local command hel…
New
askmdb-9b-GGUF
manuelgscom · Kit
Writes a read-only MongoDB aggregate pipeline from a plain Spanish or English question. A GGUF copy of a Qwen3.5-9B fine-tune that runs locally with llama.cpp,…
New
Maincoder-1B
Maincode · Kit
Completes and writes Python code from a function signature or a docstring. A 1B code model from Maincode that is small enough to run on consumer hardware, for…
New
Qwen3.8-27B-MLX-8bit
lmstudio-community · Kit
Runs a 27B model that reads images and text in an 8-bit MLX build for Apple Silicon Macs. It suits people who want picture questions answered locally.
New
ColGrep-Agent-2B
lightonai · Kit
A 2.5B-parameter model that finds the files and line ranges relevant to a bug report or question about a code repository, by searching and reading the repo. Ru…
New
Qwen3.8-27B-oQ8e-mtp
Jundot · Kit
Runs Qwen3.8-27B as an 8-bit mixed-precision MLX checkpoint with its vision encoder and MTP head, for image and text chat on Apple hardware. For people who wan…
New
humanizer-GGUF
jialinyyzz · Kit
Rewrites AI-written drafts in English and Chinese so they read like a person wrote them, keeping numbers, dates, names and quotes. A 12B model in GGUF files fo…
New
Runs a tiny 0.8B reasoning-tuned chat model in the MLX format at 6-bit, converted from Jackrong's Qwen3.5 distilled model. For people who want a tiny local mod…
New
granite-4.2-8b GGUF
ibm-granite · Kit
Holds GGUF copies of IBM's Granite 4.2 8B model in several quantization levels, ready for llama.cpp. For people who want to run the model locally and read its…
New
Granite-4.2-3B (GGUF)
ibm-granite · Kit
Packages IBM's Granite 4.2 3B text model as GGUF files for local use. The 4-bit weights are estimated at about 1.8 GB, for people who want a compact model unde…
New
Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF
hesamation · Kit
Runs a reasoning-tuned Qwen3.6-35B-A3B on your own machine as GGUF files in four quant sizes, trained on Claude Opus 4.6 style reasoning data. For people who w…
New
phonon-31m English for llama.cpp
gradium · Kit
Turns English text into speech from the command line or a local server, as a GGUF copy of the Phonon 31M model for llama.cpp. It suits developers who already r…
New
Qwen2.5-Coder-1.5B Q8_0 GGUF
ggml-org · Kit
Runs Qwen2.5-Coder 1.5B on your own machine as a Q8_0 GGUF file through llama.cpp, from the command line or as a local server. It suits developers who want a s…
New
embeddinggemma-2 GGUF
ggml-org · Kit
Runs a GGUF copy of Google's embeddinggemma-2, a 271M feature extraction model, with the llama command or the Llama app. For developers who want a small text e…
New
GLiNER2.5-multi-Decide
fastino · Kit
Classifies text into labels you pass at call time, in one pass and with no prompt template. A 287M model for routing, intent, sentiment and moderation on non-E…
New
Gemma-3-12b-it-MAX-HORROR-Imatrix-GGUF
DavidAU · Kit
Writes fiction with a tint of horror. GGUF builds of Gemma 3 12B instruct, quantized with an imatrix made from a horror model, for creative writers who run mod…
New