Granite RAG Library
ibm-granite · Kit
Adds six LoRA adapters for IBM Granite models that rewrite queries, ask for clarification, judge passages, check answerability and flag hallucinations in RAG p…
Prompts, coding agent briefs and kits for writing and reviewing code with fewer tokens.
ibm-granite · Kit
Adds six LoRA adapters for IBM Granite models that rewrite queries, ask for clarification, judge passages, check answerability and flag hallucinations in RAG p…
ibm-granite · Kit
Converts document page images into structured text, with equations, layout and questions about page elements, in a 258M model from IBM Research. For people who…
ibm-granite · Kit
Holds GGUF copies of IBM's Granite 4.2 8B model in several quantization levels, ready for llama.cpp. For people who want to run the model locally and read its…
ibm-granite · Kit
Packages IBM's Granite 4.2 3B text model as GGUF files for local use. The 4-bit weights are estimated at about 1.8 GB, for people who want a compact model unde…
ibm-granite · Kit
Handles summaries, classification, extraction, question answering, RAG, code tasks and tool calling in 12 languages with a 340M-parameter instruct model from I…
bartowski · Kit
Quantized GGUF copies of IBM's granite-4.2-3b text model, in many sizes from full precision down to small 3-bit files. For people who run a small chat model on…
vladers · Kit
Converts speech to text in seven languages, as quantized GGUF versions of IBM's Granite Speech 5.0 TurboCTC 470M, built for transcribe.cpp. For developers addi…
unsloth · Kit
Follows instructions, calls tools and chats with IBM's Granite 4.1 8B model, in GGUF files by Unsloth that include chat template fixes. Made for business assis…
ibm-granite · Kit
Reasons step by step before it answers, with tool calling, code generation and multilingual chat, in a compact 3B model from IBM. Supports a 128K context nativ…
ibm-granite · Kit
Turns speech in seven languages into punctuated, capitalized text. A small 470M-parameter model from IBM Granite for fast transcription on servers, laptops and…
ibm-granite · Kit
Works through a problem in steps before it answers, for math, code, tool calling and multilingual chat. IBM's largest dense Granite 4.2 model, under Apache 2.0…
ibm-granite · Kit
Reasons step by step, writes code, calls tools and chats in several languages with a context of up to 128K tokens, extendable to 512K. IBM's dense 8B model, fo…
ibm-granite · Kit
Runs a static web page from ibm-granite in your browser with nothing to install, and its files can be downloaded to open on your own computer.