gemma-4-31b-it-exl3-optimized
Dino0040 · Kit
Holds the measurements and recipes for building an optimized EXL3 quant of Gemma 4 31B-it at any bitrate. For people who quantize models with exllamav3 and wan…
New
Kits of AI agent skills, rules and prompts
Categories and filters
Listings
DeepSeek-V4.1-Flash-1017-exl3
turboderp · Kit
Runs a compressed DeepSeek-V4.1-Flash-1017 in ExLlamaV3 at 1.68, 2.25 or 2.68 bits per weight. For people who run large models on their own hardware and want l…
New
Qwen3.8-27B-exl3
turboderp · Kit
EXL3 quantized copies of Qwen3.8-27B in many bits-per-weight sizes, from 1.40 to 6.00. For people running the 27B model locally with ExLlamaV3 on limited GPU m…
New
DeepSeek-V4.1-Flash-1017 EXL3 EAQ v1 2.9 bpw
Mia-AiLab · Kit
A 2.9 bits-per-weight EXL3 quantization of DeepSeek-V4.1-Flash-1017 that reads text and images. It cuts the model to about 210 GB for exllamav3 runtimes, and t…
New