Bonsai-27B-GGUF
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
An instruction-tuned 31B model from Google DeepMind that reads text and images and writes text, with a 256K context and configurable thinking. For developers who run an open model on a workstation or server.
gemma-4-31B-it is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.
pip install -U huggingface_hub hf download google/gemma-4-31B-it
gemma-4-31B-it is the instruction-tuned 31B dense model of Gemma 4, an open model family from Google DeepMind. It takes text and images and writes text. It has a context window of 256K tokens and supports more than 140 languages. Its weights are open under Apache 2.0.
It suits developers, researchers and teams who want an open model for chat, coding, reasoning and agents, hosted on their own GPU or server.
| Industry | Who uses it | How they use it | Example |
|---|---|---|---|
| Software | Developers | Add a multimodal assistant to an app | A helper that answers questions about screenshots |
| Global business | Support and content teams | Work in many languages with one model | Reply to customers in their own language |
| Agent building | Agent developers | Use function calling to drive tools | An agent that looks up orders through an API |
| AI research | Researchers | Study an open reasoning model | Compare thinking modes on the same questions |
If you need audio input or a model for a phone, you can skip it, because audio sits only in the smaller sizes and the 31B has none.
| Use case | Who | What they get back |
|---|---|---|
| Chat and reasoning | Developers | Text answers, with a thinking mode you can configure |
| Image questions | Product teams | Text answers about an image of any shape or size |
| Tool-driven agents | Agent builders | Function calls the model chooses to make |
You need these first:
pip install -U huggingface_hub hf download google/gemma-4-31B-it
Chat with the model through its chat template, using the system role for instructions. Pick a thinking mode when you want step-by-step reasoning, and send an image along with your text when you have one.
| Tool | What it does |
|---|---|
| System role | Native support for a system message, for more controllable conversations |
| Thinking modes | Configurable reasoning before the final answer |
| Function calling | Native support for calling tools, which agents rely on |
| Image input | Takes images with a variable aspect ratio and resolution |
You send a photo of a receipt and ask for the total and the shop name. The model reads the image and answers in text. With a system message, you can also fix the answer format.
This is a large general model that understands pictures as well as words. A good first step is to read the model card, then try one text question and one image question.
The model mixes local sliding window attention, 1024 tokens wide, with full global attention, and the last layer is always global. Global layers share keys and values and use proportional RoPE. It has 60 layers and a vision encoder of about 550M parameters.
The Gemma 4 family has five sizes, and this one is the largest dense model.
An instruction-tuned 31B model from Google DeepMind that reads text and images and writes text, with a 256K context and configurable thinking. For developers who run an open model on a workstation or server.
Made by google on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.
What it is: gemma-4-31B-it is the instruction-tuned 31B dense model of Gemma 4, an open model family from Google DeepMind. It takes text and images and writes text. It has a context window of 256K tokens and supports more than 140 languages. Its weights are open under Apache 2.0.
Who it suits: It suits developers, researchers and teams who want an open model for chat, coding, reasoning and agents, hosted on their own GPU or server.
Industry | Who uses it | How they use it | Example
Software | Developers | Add a multimodal assistant to an app | A helper that answers questions about screenshots
Global business | Support and content teams | Work in many languages with one model | Reply to customers in their own language
Agent building | Agent developers | Use function calling to drive tools | An agent that looks up orders through an API
AI research | Researchers | Study an open reasoning model | Compare thinking modes on the same questions
If you need audio input or a model for a phone, you can skip it, because audio sits only in the smaller sizes and the 31B has none.
Where to use it:
Use case | Who | What they get back
Chat and reasoning | Developers | Text answers, with a thinking mode you can configure
Image questions | Product teams | Text answers about an image of any shape or size
Tool-driven agents | Agent builders | Function calls the model chooses to make
How to set it up: You need these first:
pip install -U huggingface_hub
hf download google/gemma-4-31B-it
How to use it: Chat with the model through its chat template, using the system role for instructions. Pick a thinking mode when you want step-by-step reasoning, and send an image along with your text when you have one.
Tool | What it does
System role | Native support for a system message, for more controllable conversations
Thinking modes | Configurable reasoning before the final answer
Function calling | Native support for calling tools, which agents rely on
Image input | Takes images with a variable aspect ratio and resolution
Example: You send a photo of a receipt and ask for the total and the shop name. The model reads the image and answers in text. With a system message, you can also fix the answer format.
For newcomers and experts: This is a large general model that understands pictures as well as words. A good first step is to read the model card, then try one text question and one image question.
The model mixes local sliding window attention, 1024 tokens wide, with full global attention, and the last layer is always global. Global layers share keys and values and use proportional RoPE. It has 60 layers and a vision encoder of about 550M parameters.
You send text and optionally an image
The model reads them with a system role
It may think before it answers
It returns text or a function call
Good to know: The Gemma 4 family has five sizes, and this one is the largest dense model.
Title: Total parameters of the dense Gemma 4 models in billions
E2B (effective): 2.3 B
E4B (effective): 4.5 B
12B Unified: 11.95 B
31B Dense: 30.7 B
Download its files with Hugging Face's command line:
pip install -U huggingface_hub
hf download google/gemma-4-31B-it
Then follow the usage in its model card. Nothing in this kit runs by itself.
README.md 5 KB
Listed Hugging Face models in the same category that share the most tags with this one.
| Product | Downloads, last 30 days | Likes | Parameters | License | Last change |
|---|---|---|---|---|---|
| gemma-4-31B-it This page | 6,692,367 | 4,348 | 31.3B | apache-2.0 | |
| gemma-4-26B-A4B-itShares gemma4 · image-text-to-text · conversational | 5,304,019 | 1,758 | 25.8B | apache-2.0 | |
| gemma-4-31B-it-scotoma-2Shares gemma4 · image-text-to-text · conversational | 1,643 | 60 | 31.3B | apache-2.0 | |
| gemma-4-E4B-it-weight-space-programmingShares gemma4 · image-text-to-text · conversational | 125 | 3 | 8B | gemma | |
| gemma-4-31B-it-qat-GGUFShares gemma4 · image-text-to-text · conversational | 79,933 | 226 | 30.7B | apache-2.0 | |
| gemma-4-E4B-itShares gemma4 · image-text-to-text · transformers | 4,298,348 | 1,850 | 8B | apache-2.0 |
Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search and on Trendshift. Mindket doesn’t write or check them. Open one to read it where it was posted.
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
LibertAIDAI · Kit
Runs DeepSeek-V4.1-Flash-1017 as a 2.9 bits-per-weight EXL3 quantization, a 196 GiB copy for people serving large models on their own hardware. Perplexity stay…
facebook · Kit
Generates short music clips from a text description or an audio prompt, in the small checkpoint of facebook's MusicGen. It suits developers and music hobbyists…
alpindale · Kit
Tags every character of C source code for syntax highlighting with a tiny neural network of about 984 weights, run through a small C program. For developers an…
prithivMLmods · Kit
Try a set of LoRAs for the FLUX.2 Klein image model in a Gradio app that runs in your browser or on your own computer. Made for people who make or test AI imag…
Sokheng · Kit
Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…