granite-4.2-8b GGUF
ibm-granite · Kit
Holds GGUF copies of IBM's Granite 4.2 8B model in several quantization levels, ready for llama.cpp. For people who want to run the model locally and read its…
ibm-granite · Kit
Holds GGUF copies of IBM's Granite 4.2 8B model in several quantization levels, ready for llama.cpp. For people who want to run the model locally and read its…
ibm-granite · Kit
Packages IBM's Granite 4.2 3B text model as GGUF files for local use. The 4-bit weights are estimated at about 1.8 GB, for people who want a compact model unde…
bartowski · Kit
Quantized GGUF copies of IBM's granite-4.2-3b text model, in many sizes from full precision down to small 3-bit files. For people who run a small chat model on…
ibm-granite · Kit
Reasons step by step before it answers, with tool calling, code generation and multilingual chat, in a compact 3B model from IBM. Supports a 128K context nativ…
ibm-granite · Kit
Works through a problem in steps before it answers, for math, code, tool calling and multilingual chat. IBM's largest dense Granite 4.2 model, under Apache 2.0…
ibm-granite · Kit
Reasons step by step, writes code, calls tools and chats in several languages with a context of up to 128K tokens, extendable to 512K. IBM's dense 8B model, fo…