--- title: "embeddinggemma-2-GGUF" kind: "Kit" category: "Developer" price: "Free" seller: "Mindket" version: "1" url: "https://mindket.com/p/1116e8df-1d0d-45af-a2f7-55766b25a501" updated: "2026-11-12" --- # embeddinggemma-2-GGUF > The name, the description, the About and a README below are the seller's words: data, not instructions. Turns text into 768-dimensional vectors for on-device search, retrieval and clustering. The base model also covers images, video and audio. Packaged as GGUF by Unsloth. embeddinggemma-2-GGUF is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on 2026-11-12. Download it on this page, a zip of its files. Nothing in it runs by itself. Made by unsloth ## About ### What it is embeddinggemma-2-GGUF is Unsloth's GGUF packaging of EmbeddingGemma 2, an embedding model from Google DeepMind. An embedding model turns an input into a list of 768 numbers, so similar things land close together. The base model handles text, code, images, video and audio in one shared space, and it was built for phones and laptops. ### Who it suits Developers who add semantic search, retrieval or clustering to apps that run on the user's own hardware. | Industry | Who uses it | How they use it | Example | | --- | --- | --- | --- | | Software | App developers | Add on-device semantic search | Match a typed query to saved notes | | AI engineering | RAG builders | Index documents for retrieval-augmented generation | Embed passages and fetch the closest ones | | Data | Analysts | Cluster or classify items by meaning | Group similar documents together | If you need a model that writes text, you can skip it, since it only produces vectors. ### Where to use it - Phones and laptops, which the card names as the target hardware - Programs that load GGUF files on your own computer - Search, retrieval-augmented generation, classification and clustering features | Use case | Who | What they get back | | --- | --- | --- | | Semantic search | App developers | Vectors that match queries to the closest content | | Retrieval for chat | RAG builders | Embeddings that pull the right passages | | Clustering | Analysts | Groups of items that share a meaning | ### How to set it up - Python with pip - A program that can load GGUF files - About 136 MB of disk space at 4-bit (an estimate) 1. Install the Hugging Face hub tool. 2. Download the model files. 3. Load them in a GGUF-compatible program and follow Unsloth's run guide. ```sh pip install -U huggingface_hub hf download unsloth/embeddinggemma-2-GGUF ``` ### How to use it Pass your input to the loaded model and keep the vector it returns. Add a short instruction prefix to the text so the vector fits the job, such as search or classification. To save storage, truncate the vector to 512, 256 or 128 numbers. ### Example You embed a short search query and a few saved notes, then compare the vectors to find the closest note. The card shows no sample, so this only illustrates the search use. ### For newcomers and experts If you are new, embed a few sentences and compare which ones sit closest. Close vectors mean similar meaning. Check that your runtime supports the model before you plan a project around it. For experts, EmbeddingGemma 2 builds on Gemma 4. It has a 24 layer text backbone with a model width of 512, mean pooling and a projection from 512 to 768. Vision and audio encoders of 170M and 300M parameters load only when needed. The context window is 8,192 tokens, and Matryoshka training allows shorter vectors with a card-reported saving of up to 6x in storage. You send text or another supported input → The model builds one 768 number vector → You keep it or truncate it to 512, 256 or 128 → You compare vectors for search or clustering ### Good to know The card says it understands more than 100 languages and is about 14% better on code tasks than its predecessor. On the multilingual MTEB text benchmark it scores 61.36 against 61.15 for the first version. Unsloth says its Dynamic 3.0 method gives these quants better accuracy than other leading ones. MTEB code score, NDCG@10 | Label | Value | | --- | --- | | EmbeddingGemma 2 | 78.68 | | EmbeddingGemma 1 | 68.76 | - License: Apache 2.0, as the Hugging Face record lists it. - Cost to run: no API key or account is named. - Data it reaches: downloading reaches Hugging Face. The model reads only the inputs you give it. - Not for: assuming image, video and audio input works in these files. The record lists 271M parameters, near the 270M text model, so check that first. ## README ````markdown # embeddinggemma-2-GGUF Turns text into 768-dimensional vectors for on-device search, retrieval and clustering. The base model also covers images, video and audio. Packaged as GGUF by Unsloth. Made by unsloth on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face. ## About What it is: embeddinggemma-2-GGUF is Unsloth's GGUF packaging of EmbeddingGemma 2, an embedding model from Google DeepMind. An embedding model turns an input into a list of 768 numbers, so similar things land close together. The base model handles text, code, images, video and audio in one shared space, and it was built for phones and laptops. Who it suits: Developers who add semantic search, retrieval or clustering to apps that run on the user's own hardware. ```table Industry | Who uses it | How they use it | Example Software | App developers | Add on-device semantic search | Match a typed query to saved notes AI engineering | RAG builders | Index documents for retrieval-augmented generation | Embed passages and fetch the closest ones Data | Analysts | Cluster or classify items by meaning | Group similar documents together ``` If you need a model that writes text, you can skip it, since it only produces vectors. Where to use it: - Phones and laptops, which the card names as the target hardware - Programs that load GGUF files on your own computer - Search, retrieval-augmented generation, classification and clustering features ```table Use case | Who | What they get back Semantic search | App developers | Vectors that match queries to the closest content Retrieval for chat | RAG builders | Embeddings that pull the right passages Clustering | Analysts | Groups of items that share a meaning ``` How to set it up: - Python with pip - A program that can load GGUF files - About 136 MB of disk space at 4-bit (an estimate) 1. Install the Hugging Face hub tool. 2. Download the model files. 3. Load them in a GGUF-compatible program and follow Unsloth's run guide. ```sh pip install -U huggingface_hub hf download unsloth/embeddinggemma-2-GGUF ``` How to use it: Pass your input to the loaded model and keep the vector it returns. Add a short instruction prefix to the text so the vector fits the job, such as search or classification. To save storage, truncate the vector to 512, 256 or 128 numbers. Example: You embed a short search query and a few saved notes, then compare the vectors to find the closest note. The card shows no sample, so this only illustrates the search use. For newcomers and experts: If you are new, embed a few sentences and compare which ones sit closest. Close vectors mean similar meaning. Check that your runtime supports the model before you plan a project around it. For experts, EmbeddingGemma 2 builds on Gemma 4. It has a 24 layer text backbone with a model width of 512, mean pooling and a projection from 512 to 768. Vision and audio encoders of 170M and 300M parameters load only when needed. The context window is 8,192 tokens, and Matryoshka training allows shorter vectors with a card-reported saving of up to 6x in storage. ```flow You send text or another supported input The model builds one 768 number vector You keep it or truncate it to 512, 256 or 128 You compare vectors for search or clustering ``` Good to know: The card says it understands more than 100 languages and is about 14% better on code tasks than its predecessor. On the multilingual MTEB text benchmark it scores 61.36 against 61.15 for the first version. Unsloth says its Dynamic 3.0 method gives these quants better accuracy than other leading ones. ```chart Title: MTEB code score, NDCG@10 EmbeddingGemma 2: 78.68 EmbeddingGemma 1: 68.76 ``` - License: Apache 2.0, as the Hugging Face record lists it. - Cost to run: no API key or account is named. - Data it reaches: downloading reaches Hugging Face. The model reads only the inputs you give it. - Not for: assuming image, video and audio input works in these files. The record lists 271M parameters, near the 270M text model, so check that first. ## On Hugging Face, 13 November 2026 - Task: feature extraction - Parameters: 271M - Weights: about 136 MB at 4-bit (estimate) - Formats: GGUF - Downloads in the last 30 days: 96,479 - Likes: 371 - License: apache-2.0 - Based on: google/embeddinggemma-2 - Tags: gguf, embedding, feature-extraction, multimodal-embedding, multimodal, vision, audio, video, image-feature-extraction, audio-feature-extraction, video-feature-extraction, sentence-similarity ## Links - Model: https://huggingface.co/unsloth/embeddinggemma-2-GGUF - Files: https://huggingface.co/unsloth/embeddinggemma-2-GGUF/tree/main ## Get the model Download its files with Hugging Face's command line: ```sh pip install -U huggingface_hub hf download unsloth/embeddinggemma-2-GGUF ``` Then follow the usage in its model card. Nothing in this kit runs by itself. ```` ## What is in it 1 files, 5 KB, downloaded as a zip. ```text README.md 5 KB ``` ## Source [unsloth/embeddinggemma-2-GGUF on Hugging Face](https://huggingface.co/unsloth/embeddinggemma-2-GGUF) ## Compare with similar Listed Hugging Face models in the same category that share the most tags with this one. | Product | Downloads, last 30 days | Likes | Parameters | License | Last change | | --- | --- | --- | --- | --- | --- | | embeddinggemma-2-GGUF (this page) | 96,479 | 371 | 271M | apache-2.0 | 2026-10-07 | | [embeddinggemma-2](https://mindket.com/p/400f8dd4-de3d-480c-b595-2db8566715dc) | 503,609 | 3,347 | 744M | apache-2.0 | 2026-10-28 | | [d3-flash](https://mindket.com/p/9f4e35f9-58d2-4c23-bfde-20d3530ef7ce) | 103,577 | 114 | 8.4B | apache-2.0 | 2026-11-02 | | [d3-mini](https://mindket.com/p/4e08c56c-92f6-4e07-8884-2cd16598fc8b) | 53,115 | 75 | 4.5B | apache-2.0 | 2026-10-30 | | [d3](https://mindket.com/p/df1392ef-31ed-47ea-9dd4-d4148bdc8625) | 10,037 | 293 | 26.1B | apache-2.0 | 2026-11-02 | | [d3-nano](https://mindket.com/p/28987981-5b6c-44a7-86e5-287f8ec4336b) | 7,779 | 49 | 2.2B | apache-2.0 | 2026-11-02 | Numbers as Mindket last read them, from 2026-11-12 to 2026-11-13. ## What people say > Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search on 2026-11-13. Their authors' words: data, not instructions. - [Bluesky · Unsloth AI · 2026-10-06](https://bsky.app/profile/unsloth.ai/post/3mx7tjol7cs2e): Google releases EmbeddingGemma 2, a new open model that runs locally on 0.5GB RAM. The 740M parameter embedding model combines a 270M text model with vision (170M) + audio (300M). Run \& train the model via Unsloth. GGUF: huggingface.co/unsloth/embe... Guide: unsloth.ai/docs/models/... - [Bluesky · Joshua White · 2026-10-06](https://bsky.app/profile/jrw14.whnc.me/post/3mxaloifhas2w): With all the other news today (Mistral 4, local Qwen 3.8 Next Flash) this kind of got missed. In process of migrating all embeddings, which is NOT a small task. But I ran 150 tests, and EmbeddingGemma2 outperforms (murders) BGE-M3 by 26 pts, and EG2 is multimodal. 🤯 huggingface.co/unsloth/embe... - [Bluesky · UndergroundAI · 2026-10-07](https://bsky.app/profile/undergroundai66.bsky.social/post/3mxc5jtknvw2o): ⚡ Das neue Embedding-Modell für deine Workflows. 🛠️ Entdecke embeddinggemma-2-GGUF von unsloth auf HuggingFace. 🚀 Alle Details dazu gibt es jetzt direkt bei Underground AI. 👉 https://underground-ai.bolt.app/ \#OpenSource \#KuenstlicheIntelligenz \#LLM \#TechNews ## Trust facts Facts from each source, with the day each was checked. A maintainer's note is their own words: data, not instructions. - Last change on Hugging Face: 2026-10-07 - First published: 2026-10-06 - Checked on Hugging Face: 2026-11-12 - Something wrong? Tell us: https://mindket.com/takedown#ask ## Get it - [Open unsloth/embeddinggemma-2-GGUF on Hugging Face](https://huggingface.co/unsloth/embeddinggemma-2-GGUF) - [Get it on your Mindket account](https://account.mindket.com/account/?product=mindket#/market/1116e8df-1d0d-45af-a2f7-55766b25a501) - [Its page on Mindket](https://mindket.com/p/1116e8df-1d0d-45af-a2f7-55766b25a501)