Bonsai-27B-GGUF
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
Google DeepMind's E4B model from the Gemma 4 family, an open model that takes text, images and audio and writes text, built to run on laptops and phones.
gemma-4-E4B is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.
pip install -U huggingface_hub hf download google/gemma-4-E4B
gemma-4-E4B is one of the Gemma 4 open models from Google DeepMind. It takes text, images and audio as input and answers in text. The record lists 8B parameters with embeddings, and the card counts 4.5B as the effective size.
The model has a context window of 128K tokens and supports more than 140 languages. It is aimed at text generation, coding and reasoning.
It suits developers and researchers who want an open multimodal model small enough for a laptop or an edge device. The family also has larger sizes, up to 31B, for workstations.
| Industry | Who uses it | How they use it | Example |
|---|---|---|---|
| Software | Developers | Add a local model for text, image and audio input | Answering a question about a photo |
| Mobile and edge | App builders | Run a model on a laptop or phone class device | A feature that works offline |
| Research | Machine learning researchers | Study or fine-tune an open model | Comparing it with the larger Gemma 4 sizes |
| Agents | Tool builders | Use function calling and thinking modes | A helper that picks a tool for a request |
Skip it if you want a hosted chatbot and have no plan to run a model.
| Use case | Who | What they get back |
|---|---|---|
| Chat and reasoning | Developers | Text answers, with configurable thinking modes |
| Image and audio questions | App builders | Text answers about a picture or a recording |
| Coding help | Engineers | Code and explanations in text |
You need a few things in place first.
pip install -U huggingface_hub hf download google/gemma-4-E4B
Once the model is loaded, you give it text and, if you like, an image or audio, and it writes text back. The card says it supports a system role for steadier conversations and native function calling for agents.
You load the model and attach a short recording. You ask "What was said in this clip?" The card lists audio input for this size, so the model reads the sound and replies in text.
Start with one short text prompt and read the reply. Add an image after that works. Audio comes last because it needs a little more setup.
The E in E4B means effective parameters. The small models give each decoder layer its own small embedding per token, and these tables are large but only used for lookups. That is why 4.5B effective sits inside 8B in total. Attention mixes local sliding windows of 512 tokens with global layers, and the last layer is always global.
Google DeepMind's E4B model from the Gemma 4 family, an open model that takes text, images and audio and writes text, built to run on laptops and phones.
Made by google on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.
What it is: gemma-4-E4B is one of the Gemma 4 open models from Google DeepMind. It takes text, images and audio as input and answers in text. The record lists 8B parameters with embeddings, and the card counts 4.5B as the effective size.
The model has a context window of 128K tokens and supports more than 140 languages. It is aimed at text generation, coding and reasoning.
Who it suits: It suits developers and researchers who want an open multimodal model small enough for a laptop or an edge device. The family also has larger sizes, up to 31B, for workstations.
Industry | Who uses it | How they use it | Example
Software | Developers | Add a local model for text, image and audio input | Answering a question about a photo
Mobile and edge | App builders | Run a model on a laptop or phone class device | A feature that works offline
Research | Machine learning researchers | Study or fine-tune an open model | Comparing it with the larger Gemma 4 sizes
Agents | Tool builders | Use function calling and thinking modes | A helper that picks a tool for a request
Skip it if you want a hosted chatbot and have no plan to run a model.
Where to use it:
Use case | Who | What they get back
Chat and reasoning | Developers | Text answers, with configurable thinking modes
Image and audio questions | App builders | Text answers about a picture or a recording
Coding help | Engineers | Code and explanations in text
How to set it up: You need a few things in place first.
pip install -U huggingface_hub
hf download google/gemma-4-E4B
How to use it: Once the model is loaded, you give it text and, if you like, an image or audio, and it writes text back. The card says it supports a system role for steadier conversations and native function calling for agents.
Example: You load the model and attach a short recording. You ask "What was said in this clip?" The card lists audio input for this size, so the model reads the sound and replies in text.
For newcomers and experts: Start with one short text prompt and read the reply. Add an image after that works. Audio comes last because it needs a little more setup.
The E in E4B means effective parameters. The small models give each decoder layer its own small embedding per token, and these tables are large but only used for lookups. That is why 4.5B effective sits inside 8B in total. Attention mixes local sliding windows of 512 tokens with global layers, and the last layer is always global.
Title: Context length of the dense Gemma 4 models
E2B: 128 K tokens
E4B: 128 K tokens
12B: 256 K tokens
31B: 256 K tokens
Download the model with hf
Load it with transformers
Send text, an image or audio
The model writes text back
Good to know:
Download its files with Hugging Face's command line:
pip install -U huggingface_hub
hf download google/gemma-4-E4B
Then follow the usage in its model card. Nothing in this kit runs by itself.
README.md 4 KB
Listed Hugging Face models in the same category that share the most tags with this one.
| Product | Downloads, last 30 days | Likes | Parameters | License | Last change |
|---|---|---|---|---|---|
| gemma-4-E4B This page | 449,316 | 508 | 8B | apache-2.0 | |
| gemma-4-E4B-itShares any-to-any · gemma4 · image-text-to-text | 4,298,348 | 1,850 | 8B | apache-2.0 | |
| gemma-4-E2B-itShares any-to-any · gemma4 · image-text-to-text | 3,017,059 | 1,129 | 5.1B | apache-2.0 | |
| gemma-4-E2BShares any-to-any · gemma4 · image-text-to-text | 109,387 | 559 | 5.1B | apache-2.0 | |
| gemma-4-12B-it-qat-GGUFShares any-to-any · gemma4 · transformers | 196,871 | 617 | 11.9B | apache-2.0 | |
| gemma-4-12B-itShares any-to-any · image-text-to-text · transformers | 1,738,905 | 1,735 | 12B | apache-2.0 |
Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search and on Trendshift. Mindket doesn’t write or check them. Open one to read it where it was posted.
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
LibertAIDAI · Kit
Runs DeepSeek-V4.1-Flash-1017 as a 2.9 bits-per-weight EXL3 quantization, a 196 GiB copy for people serving large models on their own hardware. Perplexity stay…
facebook · Kit
Generates short music clips from a text description or an audio prompt, in the small checkpoint of facebook's MusicGen. It suits developers and music hobbyists…
alpindale · Kit
Tags every character of C source code for syntax highlighting with a tiny neural network of about 984 weights, run through a small C program. For developers an…
prithivMLmods · Kit
Try a set of LoRAs for the FLUX.2 Klein image model in a Gradio app that runs in your browser or on your own computer. Made for people who make or test AI imag…
Sokheng · Kit
Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…