GLM-5.3-Flash EXL3 3.05bpw
albucino · Kit
Runs GLM-5.3-Flash locally on two RTX 3090 cards with 128 GB of RAM and a 262,144-token context, using a verified 3.05 bpw EXL3 quantization. For people hostin…
New
albucino · Kit
Runs GLM-5.3-Flash locally on two RTX 3090 cards with 128 GB of RAM and a 262,144-token context, using a verified 3.05 bpw EXL3 quantization. For people hostin…
prajwalpujari16 · Kit
A browser registry of LLM serving benchmarks measured on consumer GPUs, dual Tesla T4 and an RTX 3050 laptop, with concurrency scaling curves and a way to subm…