Qwen3.8-27B-DSpine-b16-GGUF
aj9o9 · Kit
A GGUF draft model that speeds up Qwen3.8-27B in llama.cpp through speculative decoding, reaching about 125 tokens per second on code and math on one RTX 3090.…
New
AI skills and agents for developers
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
Categories and filters
Listings
Qwen3.8-27B-GSQ-RCO-GGUF
ISTA-DASLab · Kit
ISTA-DASLab's GGUF versions of Qwen3.8-27B in four sizes, each tensor quantized at its own precision, with a vision projector for images. Suits people who run…
New
MiniCPM-V
OpenBMB · Kit
OpenBMB’s open multimodal models: MiniCPM-V 4.7 reads images, documents and video, and MiniCPM-o 4.5 also hears and speaks. The setup notes cover Transformers,…
New27.1k
bitnet.cpp
microsoft · Kit
Microsoft’s official inference framework for 1-bit LLMs, built on llama.cpp. It runs ternary models such as BitNet b1.58 on x86 and ARM CPUs, and has a GPU ker…
New41.5k