Qwen3.8-27B GGUF (ShapeLearn Quantized)
byteshape · Kit
Runs Qwen3.8-27B as GGUF files quantized by ByteShape's ShapeLearn, in five GPU-sized options with vision input and MTP speculative decoding in llama.cpp. For…
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
byteshape · Kit
Runs Qwen3.8-27B as GGUF files quantized by ByteShape's ShapeLearn, in five GPU-sized options with vision input and MTP speculative decoding in llama.cpp. For…
aj9o9 · Kit
A GGUF draft model that speeds up Qwen3.8-27B in llama.cpp through speculative decoding, reaching about 125 tokens per second on code and math on one RTX 3090.…
ISTA-DASLab · Kit
ISTA-DASLab's GGUF versions of Qwen3.8-27B in four sizes, each tensor quantized at its own precision, with a vision projector for images. Suits people who run…
OpenBMB · Kit
OpenBMB’s open multimodal models: MiniCPM-V 4.7 reads images, documents and video, and MiniCPM-o 4.5 also hears and speaks. The setup notes cover Transformers,…
microsoft · Kit
Microsoft’s official inference framework for 1-bit LLMs, built on llama.cpp. It runs ternary models such as BitNet b1.58 on x86 and ARM CPUs, and has a GPU ker…