Bonsai-1.7B-unpacked
prism-ml · Kit
FP16 safetensors copy of the 1-bit Bonsai-1.7B model, for running it in standard Hugging Face tools. The card advises the native 1-bit releases instead, which…
New
prism-ml · Kit
FP16 safetensors copy of the 1-bit Bonsai-1.7B model, for running it in standard Hugging Face tools. The card advises the native 1-bit releases instead, which…
prism-ml · Kit
Runs a 27B-class reasoning model packed to 1 bit per weight, about 3.9 GB, on Apple MLX, with 262K-token context. For developers who want a large model on a ph…
prism-ml · Kit
Runs a 27B-class reasoning model as a 1-bit GGUF file of about 3.9 GB for llama.cpp, so it fits a laptop or one GPU. For people who want local reasoning on eve…
microsoft · Kit
Microsoft’s official inference framework for 1-bit LLMs, built on llama.cpp. It runs ternary models such as BitNet b1.58 on x86 and ARM CPUs, and has a GPU ker…