Mindket

gemma-4-12B-it

Newversion 1 · updated

Overview

Takes text, images and audio and writes text answers, in one 12B instruction-tuned model from Google DeepMind with a 256K-token context and configurable thinking. For developers running open models locally.

gemma-4-12B-it is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.

At a glance

You need
  • Python on Windows, macOS or Linux
  • The huggingface_hub package
  • The transformers library to run the model
  • A consumer GPU or workstation with enough memory
Runs in
  • Python with the transformers library
  • Consumer GPUs and workstations, which the card names as the target for this size
  • Windows, macOS or Linux with Python, to download the files
Start with
pip install -U huggingface_hub
hf download google/gemma-4-12B-it

Platform

WindowsOperating system
macOSOperating system
LinuxOperating system

About

What it is

gemma-4-12B-it is the instruction-tuned 12B Unified model of Google DeepMind's Gemma 4 open family. It understands audio and images natively, without separate encoders, and writes text. The context window reaches 256K tokens, and the family covers more than 140 languages.

Who it suits

It suits developers who want a capable open model on a consumer GPU or workstation for reasoning, coding and multimodal work.

IndustryWho uses itHow they use itExample
Software developmentDevelopersUse it for coding help and agent workflows with function callingAsking it to fix a failing test
Accessibility and mediaApp buildersProcess spoken audio and images in one modelDescribing a photo and answering a question about it
ResearchResearchersFine-tune or evaluate an open model with a long contextTesting long-document question answering
Multilingual productsProduct teamsServe users in many languages from one local modelAnswering a support question in another language

You can skip it if you need a phone-sized model, since the family has smaller E2B and E4B sizes for that.

Where to use it

  • Python with the transformers library
  • Consumer GPUs and workstations, which the card names as the target for this size
  • Windows, macOS or Linux with Python, to download the files
Use caseWhoWhat they get back
Reasoning and codingDevelopersText answers, with thinking modes you can configure
Audio and image questionsApp buildersText answers about what the model hears or sees
Agent workflowsAgent developersNative function calls and system-role instructions

How to set it up

You need Python and a machine that can hold the weights, about 23.9 GB in BF16 or roughly 6 GB at 4-bit as an estimate.

  • Python on Windows, macOS or Linux
  • The huggingface_hub package
  • The transformers library to run the model
  • A consumer GPU or workstation with enough memory
  1. Install huggingface_hub.
  2. Download the model files to your computer.
  3. Load the model with transformers and follow the run steps on the model page.
pip install -U huggingface_hub
hf download google/gemma-4-12B-it

How to use it

The visible card gives the download step and points to its own run section. You load the instruction-tuned checkpoint, write a system message to set behavior, and send text, images or audio.

hf download google/gemma-4-12B-it

Example

You send the model a photo and ask what is in it. The reply comes back as text, and you can also pick a thinking mode if you want it to reason before it answers.

For newcomers and experts

If you are new to open models, this is a mid-sized one that handles pictures and sound as well as text. A first small try is to download it and ask one short question in plain text.

For people who know the field, the model has 48 layers and a hybrid attention design that mixes local sliding windows of 1024 tokens with global layers, ending on a global one. Being encoder-free is a trade-off in size and deployment, since audio and vision pass through the model itself.

  1. Text, image or audio goes in
  2. The unified model handles all inputs together
  3. It may think first if a thinking mode is on
  4. You get a text answer

Good to know

The Gemma 4 line offers five models, from the phone-class E2B and E4B up to the 31B, and this 12B is one of the three that hear audio natively.

  • License: Apache 2.0
  • Cost to run: none named
  • Data it reaches: the text, images and audio you send, plus the downloaded model files
  • Not for: audio generation, since the model writes text output

README and files

README

gemma-4-12B-it

Takes text, images and audio and writes text answers, in one 12B instruction-tuned model from Google DeepMind with a 256K-token context and configurable thinking. For developers running open models locally.

Made by google on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.

About

What it is: gemma-4-12B-it is the instruction-tuned 12B Unified model of Google DeepMind's Gemma 4 open family. It understands audio and images natively, without separate encoders, and writes text. The context window reaches 256K tokens, and the family covers more than 140 languages.

Who it suits: It suits developers who want a capable open model on a consumer GPU or workstation for reasoning, coding and multimodal work.

Industry | Who uses it | How they use it | Example
Software development | Developers | Use it for coding help and agent workflows with function calling | Asking it to fix a failing test
Accessibility and media | App builders | Process spoken audio and images in one model | Describing a photo and answering a question about it
Research | Researchers | Fine-tune or evaluate an open model with a long context | Testing long-document question answering
Multilingual products | Product teams | Serve users in many languages from one local model | Answering a support question in another language

You can skip it if you need a phone-sized model, since the family has smaller E2B and E4B sizes for that.

Where to use it:

  • Python with the transformers library
  • Consumer GPUs and workstations, which the card names as the target for this size
  • Windows, macOS or Linux with Python, to download the files
Use case | Who | What they get back
Reasoning and coding | Developers | Text answers, with thinking modes you can configure
Audio and image questions | App builders | Text answers about what the model hears or sees
Agent workflows | Agent developers | Native function calls and system-role instructions

How to set it up: You need Python and a machine that can hold the weights, about 23.9 GB in BF16 or roughly 6 GB at 4-bit as an estimate.

  • Python on Windows, macOS or Linux
  • The huggingface_hub package
  • The transformers library to run the model
  • A consumer GPU or workstation with enough memory
  1. Install huggingface_hub.
  2. Download the model files to your computer.
  3. Load the model with transformers and follow the run steps on the model page.
pip install -U huggingface_hub
hf download google/gemma-4-12B-it

How to use it: The visible card gives the download step and points to its own run section. You load the instruction-tuned checkpoint, write a system message to set behavior, and send text, images or audio.

hf download google/gemma-4-12B-it

Example: You send the model a photo and ask what is in it. The reply comes back as text, and you can also pick a thinking mode if you want it to reason before it answers.

For newcomers and experts: If you are new to open models, this is a mid-sized one that handles pictures and sound as well as text. A first small try is to download it and ask one short question in plain text.

For people who know the field, the model has 48 layers and a hybrid attention design that mixes local sliding windows of 1024 tokens with global layers, ending on a global one. Being encoder-free is a trade-off in size and deployment, since audio and vision pass through the model itself.

Text, image or audio goes in
The unified model handles all inputs together
It may think first if a thinking mode is on
You get a text answer

Good to know: The Gemma 4 line offers five models, from the phone-class E2B and E4B up to the 31B, and this 12B is one of the three that hear audio natively.

  • License: Apache 2.0
  • Cost to run: none named
  • Data it reaches: the text, images and audio you send, plus the downloaded model files
  • Not for: audio generation, since the model writes text output

On Hugging Face, 13 November 2026

  • Task: any to any
  • Library: transformers
  • Parameters: 12B
  • Weights: about 23.9 GB in BF16; about 6 GB at 4-bit (estimate)
  • Formats: Safetensors
  • Downloads in the last 30 days: 1,738,905
  • Likes: 1,735
  • License: apache-2.0
  • Based on: google/gemma-4-12B
  • Quantized versions: 403
  • Fine-tunes: 306
  • Tags: transformers, safetensors, gemma4_unified, image-text-to-text, any-to-any

Links

Get the model

Download its files with Hugging Face's command line:

pip install -U huggingface_hub
hf download google/gemma-4-12B-it

Then follow the usage in its model card. Nothing in this kit runs by itself.

Files
README.md  5 KB

1 file, 5 KB, downloaded as a zip.

What’s new

  • Version 1 · 2026-11-12

Compare with similar

Listed Hugging Face models in the same category that share the most tags with this one.

ProductDownloads, last 30 daysLikesParametersLicenseLast change
gemma-4-12B-it This page1,738,9051,73512Bapache-2.0
gemma-4-12BShares gemma4_unified · any-to-any · image-text-to-text51,22886112Bapache-2.0
Jev-OmniShares gemma4_unified · image-text-to-text · transformers3,74445012Bapache-2.0
gemma-4-12b-it-GGUFShares gemma4_unified · image-text-to-text2,534,53096311.9Bapache-2.0
gemma-4-E4B-itShares any-to-any · image-text-to-text · transformers4,298,3481,8508Bapache-2.0
gemma-4-E2B-itShares any-to-any · image-text-to-text · transformers3,017,0591,1295.1Bapache-2.0
Numbers as Mindket last read them, from 2026-11-12 to 2026-11-13.

Reviews

No ratings yet

Write a review

No reviews yet.

What people say

Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search and on Trendshift. Mindket doesn’t write or check them. Open one to read it where it was posted.

herfLaunch HN: Magnitude (YC S25) – Self-optimizing inference engine for agentsI have two NVIDIA GPUs (16GB+16GB) here, and it detects them each twice (says I have 4 GPUs). But then, it says most models are too big (anything >8GB?) and seems to run only on one GPU (5070ti). Unfortunately even with my 5070ti, llama.cpp seems to be about 20-30% faster at decode, running as:…SkynetAndChill.comGoogle releases Gemma 4 12B in QAT GGUF format, enabling near-full-precision quality on consumer GPUs with llama.cpp and Ollama support2 likes · 2 repliesCMayQwen 3.8 27BGemma 4 12B, Gemma 4 12B QAT, Gemma 4 31B, Gemma 4 31B QAT Gemma 4 26BA4B would get close, but not quite and sometimes even get stuck in loops despite a repeat penalty. Do not use any newer updated templates or Unsloth fixes. Use older official templates that released with the models on the…ほしけん今日リリースされたローカルLLMのGoogle Gemma 4 12B 日本語が怪しいとか壊れているとか言われてますが、 Windows の LM Studio だと、lmstudio-community/gemma-4-12B-it-GGUF なら特に問題なかった。 Unsloth や ggml-org だと日本語以前にそもそも回答時エラーになって動かなかった1 replydofmNativ: Run frontier open models locally on your MacOn an M1 Max I have been using either Unsloth Studio (which is basically a web app) or LM Studio (nicer app on the Mac). You can use the Google AI Edge Gallery to play with the smaller Gemma models (but at the moment the QAT variants don't seem to be there unless I am missing something). I think…@k1imber.bsky.social💫 Gemma-4-12B-it-QAT: мощная модель для ноутбука с RTX 2000 Ada Как уместить крупную языковую модель в ноутбук с RTX 2000 Ada и сохранить производительность. • Обучение на топовом оборудовании Google • Квантование QAT для сохранения качества при 4 битах • Точные ответы и свежие знания до начала 2…adrian_bThe unbearable cheapness of open weight modelsAn "open weights" model is one where you can download all the data and the code that you need to run inference with that model on your own hardware (typically from Huggingface.co). That data includes not only the "weights" but also various files with required information, e.g. the tokenizer, the…Google Gemma {bot}Access the updated Gemma 4 12B file: https://huggingface.co/litert-community/gemma-4-12B-it-litert-lm Quickly try Gemma using LiteRT-LM CLI: https://ai.google.dev/edge/litert-lm/cli Learn more about building with LiteRT-LM: https://developers.google.com/edge/litert-lm/overviewjack_ppGemma 4 QAT models: Optimizing compression for mobile and laptop efficiencyRan hf.co/google/gemma-4-12B-it-qat-q4_0-gguf:Q4_0 with ollama on a AMD Ryzen 9 8940HX, NVIDIA GeForce RTX 5060 (8 GB), 14 GB RAM laptop and it is suprisingly fastGoogle Gemma {bot}Ready to dive deeper into Encoder-Free Gemma 4? Check out these resources to get started: - Hugging Face: https://huggingface.co/google/gemma-4-12B-it - GitHub: https://github.com/google-gemma/gemma-skills - Visual Guide (via @MaartenGr):minimaxirGemma 4 QAT models: Optimizing compression for mobile and laptop efficiencyIsn’t this it? https://huggingface.co/google/gemma-4-12B-it-qat-q4_0-ggufprobbrain.com🆕 AI news (last 15m): • HuggingFace: google/gemma-4-12B-it · 115♥ · 463 dl • Hacker News: Mathematicians issue warning as AI rapidly gains ground • OpenAI: Introducing new capabilities to GPT-Rosalind → probbrain.com/news

Searched

More from Mindket

See all from Mindket

anaksor-ocr

Sokheng · Kit

Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…

New

Qwen2.5-7B-Instruct as GGUF files in eight quantization sizes, to chat with locally through llama.cpp. For people who want a capable 7.6B model on their own co…

New

ACE-Step 1.5 XL SFT

ACE-Step · Kit

Generates music from text with a 4B diffusion decoder, 50 steps and guidance control, aiming for higher audio quality than the base. For creators with a GPU of…

New

Similar in Developer

See all in Developer

Claude Code Skills & Plugins

alirezarezvani · Skill

Adds 411 ready-made skills for Claude Code and other coding agents, grouped by role from engineering and product to marketing, finance and compliance. Installs…

New29.8k

buzz

block · Kit

Self-hostable workspace where people and AI agents share the same rooms, built on a Nostr relay that logs every action as a signed event. For teams that want t…

New37.3k

plannotator

backnotprop · Kit

Opens your AI coding agent's plans, specs and code changes in a browser so you can annotate or comment on them and send the feedback straight back to the agent.

New10.5k