DeepSeek-V4.1-Flash-1017 EXL3 2.9 bpw
LibertAIDAI · Kit
Runs DeepSeek-V4.1-Flash-1017 as a 2.9 bits-per-weight EXL3 quantization, a 196 GiB copy for people serving large models on their own hardware. Perplexity stay…
New
Browse AI skills, agents and automations
Categories and filters
No listing has every word of “exl2”. Showing what matches “exl3” instead.
Listings
DeepSeek-V4.1-Flash-1017-EXL3-franken-v100
philbert440 · Kit
Runs DeepSeek V4.1 Flash at its full 1M-token context on eight Tesla V100 32 GB cards, using an EXL3 expert pack and an SM70 vLLM build. For owners of such ser…
New
GLM-5.3-Flash EXL3 4bpw for TensorFold
Mia-AiLab · Kit
4-bit EXL3 quantization of GLM-5.3-Flash prepared for TensorFold, with lower KL divergence than a popular TR3-4bpw quant at the same size. For people serving l…
New
gemma-4-31b-it-exl3-optimized
Dino0040 · Kit
Holds the measurements and recipes for building an optimized EXL3 quant of Gemma 4 31B-it at any bitrate. For people who quantize models with exllamav3 and wan…
New
GLM-5.3-Flash EXL3 3.05bpw
albucino · Kit
Runs GLM-5.3-Flash locally on two RTX 3090 cards with 128 GB of RAM and a 262,144-token context, using a verified 3.05 bpw EXL3 quantization. For people hostin…
New
GLM-5.3-Flash EXL3 Spark
0xSero · Kit
Runs GLM-5.3-Flash with a 256k-token context and image input on one DGX Spark, using a mixed 2.31 bits-per-weight EXL3 build. For people hosting a large model…
New
GLM-5.3-Flash EXL3 3.5bpw
Mia-AiLab · Kit
Quantized copy of GLM-5.3-Flash in EXL3 format, 156 GB, with narrower routed experts, about 11 percent smaller than the same lab's 4-bit version. For people ru…
New
DeepSeek-V4.1-Flash-1017-exl3
turboderp · Kit
Runs a compressed DeepSeek-V4.1-Flash-1017 in ExLlamaV3 at 1.68, 2.25 or 2.68 bits per weight. For people who run large models on their own hardware and want l…
New
Qwen3.8-27B-exl3
turboderp · Kit
EXL3 quantized copies of Qwen3.8-27B in many bits-per-weight sizes, from 1.40 to 6.00. For people running the 27B model locally with ExLlamaV3 on limited GPU m…
New
DeepSeek-V4.1-Flash-1017 EXL3 EAQ v1 2.9 bpw
Mia-AiLab · Kit
A 2.9 bits-per-weight EXL3 quantization of DeepSeek-V4.1-Flash-1017 that reads text and images. It cuts the model to about 210 GB for exllamav3 runtimes, and t…
New
DeepSeek-V4.1-Flash-EXL3-3bpw-2x-RTX-PRO-6000
diffbot · Kit
Serves a 3-bit compressed copy of DeepSeek-V4.1-Flash-1017 on two 96 GB RTX PRO 6000 Blackwell cards with vLLM, for developers who host a large coding and agen…
New