Qwen3.8-27B Fable-5 Coding Distilled GGUF
mradermacher · Kit
GGUF quantized files of a 27.3B coding-distilled Qwen3.8 model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit developers who run a cod…
New
AI skills and agents for developers
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Categories and filters
Listings
VulnLLM-R-7B-8bit
mlx-community · Kit
Runs an 8-bit MLX copy of VulnLLM-R-7B for text generation through mlx-lm. Meant for developers who want to try the model locally. The card does not say what i…
New
Qwen3.8-27B-MLX-8bit
lmstudio-community · Kit
Runs a 27B model that reads images and text in an 8-bit MLX build for Apple Silicon Macs. It suits people who want picture questions answered locally.
New
Qwen3.8-27B-oQ8e-mtp
Jundot · Kit
Runs Qwen3.8-27B as an 8-bit mixed-precision MLX checkpoint with its vision encoder and MTP head, for image and text chat on Apple hardware. For people who wan…
New
Qwen3.8-27B Splash 8-bit
dmeight · Kit
Runs Qwen3.8-27B at 8-bit through the Splash runtime in LM Studio on Apple silicon. An unofficial package that keeps the model closer to the original than the…
New
Qwen3.6-35B-A3B-8bit (MLX)
mlx-community · Kit
8-bit MLX conversion of Qwen3.6-35B-A3B that reads text and images and answers in text, run with the mlx-vlm tool. For developers who want to run a large visio…
New
Slonik-27B-oQ8-mtp
kakoka · Kit
Helps write and change PostgreSQL source code with a 27B coding model, 8-bit quantized to run locally on Apple Silicon Macs through oMLX. For PostgreSQL develo…
New
Qwen3-Reranker-0.6B-Q8_0-GGUF
ggml-org · Kit
Ranks passages by relevance to a query, as an 8-bit GGUF copy of the Qwen3 0.6B reranker made with llama.cpp. For developers who want a small local reranker fo…
New
AREX-2 GGUF
mradermacher · Kit
GGUF quantized files of BAAI's AREX-2, a 26.9B model, from 2-bit to 8-bit with an optional multi-modal supplement. They suit people who run a large model local…
New
Idol-GGUF
TimeLordRaps · Kit
An 8-bit GGUF build of SperiD Labs' Idol that turns one image into a 3D Gaussian point cloud and a mesh, run locally with idol.cpp. For developers working on i…
New