Bonsai-27B-GGUF
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
Reads text and images and writes text, for developers who want an open-weights Google DeepMind model for coding, reasoning and image questions on their own GPU or workstation.
gemma-4-26B-A4B is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.
pip install -U huggingface_hub hf download google/gemma-4-26B-A4B
Gemma 4 26B A4B is one size in the open Gemma 4 family from Google DeepMind. It reads text and images and writes text, using a Mixture-of-Experts design. The repository holds about 25.8B parameters as Safetensors files for the transformers library.
It suits developers and researchers who want an open-weights model for text generation, coding, reasoning and image understanding, run on a consumer GPU or a workstation.
| Industry | Who uses it | How they use it | Example |
|---|---|---|---|
| Software | Developers | Add coding help and reasoning to their own apps | Ask it to review a function |
| Research | Machine learning researchers | Study an open Mixture-of-Experts model | Compare it with the dense sizes in the family |
| Product teams | Agent builders | Build assistants that call functions | Give the model a tool and let it decide when to use it |
Anyone who needs audio input can skip this size, since the card lists audio only for the E2B, E4B and 12B models.
| Use case | Who | What they get back |
|---|---|---|
| Text generation | Writers and developers | Written replies to a prompt |
| Coding help | Developers | Code and explanations in text |
| Image questions | Anyone with pictures to check | Text answers about an image you supply |
| Reasoning | Researchers | Step-by-step answers, with thinking modes you can configure |
You need Python and enough disk space. The BF16 files weigh about 51.6 GB, and a 4-bit copy is estimated at about 12.9 GB.
pip install -U huggingface_hub hf download google/gemma-4-26B-A4B
Load the downloaded files with transformers and give the model text, or an image together with text. The system role lets you set ground rules for a conversation. The card says thinking modes are configurable and points to its own pages for the exact settings.
You hand the model a photo of a chart and ask for the main trend in two sentences. It answers in text. A system message can tell it to keep replies short and formal.
Think of it as a model that looks at a picture and a question, then writes an answer. A first small test is one image and one short question. The family also has smaller sizes if this one is too big for your computer.
Underneath, attention layers alternate between a local sliding window and full global attention, and the last layer is always global. Global layers share keys and values and use Proportional RoPE to save memory on long contexts. The Mixture-of-Experts design trades a larger file for cheaper work per token.
The family reaches a context window of 256K tokens and supports more than 140 languages. Other people have published 35 quantized and 91 fine-tuned versions of this model. The release has pre-trained and instruction-tuned variants, so check the repository name to see which one you get.
Reads text and images and writes text, for developers who want an open-weights Google DeepMind model for coding, reasoning and image questions on their own GPU or workstation.
Made by google on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.
What it is: Gemma 4 26B A4B is one size in the open Gemma 4 family from Google DeepMind. It reads text and images and writes text, using a Mixture-of-Experts design. The repository holds about 25.8B parameters as Safetensors files for the transformers library.
Who it suits: It suits developers and researchers who want an open-weights model for text generation, coding, reasoning and image understanding, run on a consumer GPU or a workstation.
Title: Who uses this model
Industry | Who uses it | How they use it | Example
Software | Developers | Add coding help and reasoning to their own apps | Ask it to review a function
Research | Machine learning researchers | Study an open Mixture-of-Experts model | Compare it with the dense sizes in the family
Product teams | Agent builders | Build assistants that call functions | Give the model a tool and let it decide when to use it
Anyone who needs audio input can skip this size, since the card lists audio only for the E2B, E4B and 12B models.
Where to use it:
Title: Jobs it does
Use case | Who | What they get back
Text generation | Writers and developers | Written replies to a prompt
Coding help | Developers | Code and explanations in text
Image questions | Anyone with pictures to check | Text answers about an image you supply
Reasoning | Researchers | Step-by-step answers, with thinking modes you can configure
How to set it up: You need Python and enough disk space. The BF16 files weigh about 51.6 GB, and a 4-bit copy is estimated at about 12.9 GB.
pip install -U huggingface_hub
hf download google/gemma-4-26B-A4B
How to use it: Load the downloaded files with transformers and give the model text, or an image together with text. The system role lets you set ground rules for a conversation. The card says thinking modes are configurable and points to its own pages for the exact settings.
Example: You hand the model a photo of a chart and ask for the main trend in two sentences. It answers in text. A system message can tell it to keep replies short and formal.
For newcomers and experts: Think of it as a model that looks at a picture and a question, then writes an answer. A first small test is one image and one short question. The family also has smaller sizes if this one is too big for your computer.
Underneath, attention layers alternate between a local sliding window and full global attention, and the last layer is always global. Global layers share keys and values and use Proportional RoPE to save memory on long contexts. The Mixture-of-Experts design trades a larger file for cheaper work per token.
Text or image goes in
Hybrid attention layers
Mixture-of-Experts blocks
Text comes out
Good to know: The family reaches a context window of 256K tokens and supports more than 140 languages. Other people have published 35 quantized and 91 fine-tuned versions of this model. The release has pre-trained and instruction-tuned variants, so check the repository name to see which one you get.
Title: Estimated weight size
BF16: 51.6 GB
4-bit: 12.9 GB
Download its files with Hugging Face's command line:
pip install -U huggingface_hub
hf download google/gemma-4-26B-A4B
Then follow the usage in its model card. Nothing in this kit runs by itself.
README.md 5 KB
Listed Hugging Face models in the same category that share the most tags with this one.
| Product | Downloads, last 30 days | Likes | Parameters | License | Last change |
|---|---|---|---|---|---|
| gemma-4-26B-A4B This page | 74,790 | 470 | 25.8B | apache-2.0 | |
| gemma-4-31B-itShares gemma4 · image-text-to-text · transformers | 6,692,367 | 4,348 | 31.3B | apache-2.0 | |
| gemma-4-26B-A4B-itShares gemma4 · image-text-to-text · transformers | 5,304,019 | 1,758 | 25.8B | apache-2.0 | |
| gemma-4-E4B-itShares gemma4 · image-text-to-text · transformers | 4,298,348 | 1,850 | 8B | apache-2.0 | |
| gemma-4-E2B-itShares gemma4 · image-text-to-text · transformers | 3,017,059 | 1,129 | 5.1B | apache-2.0 | |
| gemma-4-E4BShares gemma4 · image-text-to-text · transformers | 449,316 | 508 | 8B | apache-2.0 |
Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search and on Trendshift. Mindket doesn’t write or check them. Open one to read it where it was posted.
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
LibertAIDAI · Kit
Runs DeepSeek-V4.1-Flash-1017 as a 2.9 bits-per-weight EXL3 quantization, a 196 GiB copy for people serving large models on their own hardware. Perplexity stay…
facebook · Kit
Generates short music clips from a text description or an audio prompt, in the small checkpoint of facebook's MusicGen. It suits developers and music hobbyists…
alpindale · Kit
Tags every character of C source code for syntax highlighting with a tiny neural network of about 984 weights, run through a small C program. For developers an…
prithivMLmods · Kit
Try a set of LoRAs for the FLUX.2 Klein image model in a Gradio app that runs in your browser or on your own computer. Made for people who make or test AI imag…
Sokheng · Kit
Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…