Granite RAG Library
ibm-granite · Kit
Adds six LoRA adapters for IBM Granite models that rewrite queries, ask for clarification, judge passages, check answerability and flag hallucinations in RAG p…
ibm-granite · Kit
Adds six LoRA adapters for IBM Granite models that rewrite queries, ask for clarification, judge passages, check answerability and flag hallucinations in RAG p…
ibm-granite · Kit
Converts document page images into structured text, with equations, layout and questions about page elements, in a 258M model from IBM Research. For people who…
ibm-granite · Kit
Holds GGUF copies of IBM's Granite 4.2 8B model in several quantization levels, ready for llama.cpp. For people who want to run the model locally and read its…
ibm-granite · Kit
Packages IBM's Granite 4.2 3B text model as GGUF files for local use. The 4-bit weights are estimated at about 1.8 GB, for people who want a compact model unde…
ibm-granite · Kit
Handles summaries, classification, extraction, question answering, RAG, code tasks and tool calling in 12 languages with a 340M-parameter instruct model from I…
bartowski · Kit
Quantized GGUF copies of IBM's granite-4.2-3b text model, in many sizes from full precision down to small 3-bit files. For people who run a small chat model on…
vladers · Kit
Converts speech to text in seven languages, as quantized GGUF versions of IBM's Granite Speech 5.0 TurboCTC 470M, built for transcribe.cpp. For developers addi…
unsloth · Kit
Follows instructions, calls tools and chats with IBM's Granite 4.1 8B model, in GGUF files by Unsloth that include chat template fixes. Made for business assis…
ibm-granite · Kit
Reasons step by step before it answers, with tool calling, code generation and multilingual chat, in a compact 3B model from IBM. Supports a 128K context nativ…
ibm-granite · Kit
Turns speech in seven languages into punctuated, capitalized text. A small 470M-parameter model from IBM Granite for fast transcription on servers, laptops and…
ibm-granite · Kit
Turns speech into text in six languages and translates speech to and from English, with keyword biasing and language prompting. A compact 2B speech-language mo…
ibm-granite · Kit
Works through a problem in steps before it answers, for math, code, tool calling and multilingual chat. IBM's largest dense Granite 4.2 model, under Apache 2.0…
ibm-granite · Kit
Reasons step by step, writes code, calls tools and chats in several languages with a context of up to 128K tokens, extendable to 512K. IBM's dense 8B model, fo…
ibm-granite · Kit
Pulls summaries, CSV data, code, tables and image descriptions out of PDFs and images, using IBM Granite Vision and Docling in a Gradio demo.
ibm-granite · Kit
Runs a static web page from ibm-granite in your browser with nothing to install, and its files can be downloaded to open on your own computer.