AI projects from GitHub

colibri

JustVugg · Kit

A hierarchical inference engine that runs large mixture-of-experts models by streaming experts from NVMe storage while keeping dense layers in RAM. It supports…

bitnet.cpp

microsoft · Kit

Microsoft’s official inference framework for 1-bit LLMs, built on llama.cpp. It runs ternary models such as BitNet b1.58 on x86 and ARM CPUs, and has a GPU ker…