Bonsai-27B-GGUF
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
Turns English text into embedding vectors for search, clustering and classification, and the vectors can be cut to a smaller size. It suits developers building retrieval apps.
nomic-embed-text-v1.5 is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.
pip install -U huggingface_hub
nomic-embed-text-v1.5 is a text embedding model with 137M parameters. It turns English text into vectors, so you can compare meaning, search documents or group similar texts. Its vectors support Matryoshka resizing, which lets you keep only the first part of each one.
It suits developers and data teams who need text vectors for retrieval, grouping or classification. You need some Python comfort to run it.
| Industry | Who uses it | How they use it | Example |
|---|---|---|---|
| Software | Developers of retrieval apps | Embed documents and user questions with different prefixes | A search box over a pile of internal notes |
| Data science | Analysts | Embed texts to cluster them, find topics or remove near duplicates | Grouping short feedback comments by theme |
| Machine learning | ML engineers | Use the vectors as input features for a classifier | Training a classifier on top of the embeddings |
People who need text in other languages can skip it, since the record lists English only.
| Use case | Who | What they get back |
|---|---|---|
| RAG indexing and querying | App developers | Document vectors and matching question vectors |
| Clustering and deduplication | Analysts | Vectors that group similar texts and expose repeats |
| Classification features | ML engineers | Vectors a classifier can train on |
pip install -U huggingface_hub
hf download nomic-ai/nomic-embed-text-v1.5
Every text you embed must start with a task prefix that tells the model what the vector is for. Add the document prefix to texts you index and the query prefix to questions. Then call encode.
from sentence_transformers import SentenceTransformer
model = SentenceTransformer("nomic-ai/nomic-embed-text-v1.5")
sentences = ['search_query: Who is Laurens van Der Maaten?']
embeddings = model.encode(sentences)
print(embeddings)To shrink the vectors, the card normalizes them, keeps the first 512 values and normalizes again.
import torch.nn.functional as F
from sentence_transformers import SentenceTransformer
matryoshka_dim = 512
model = SentenceTransformer("nomic-ai/nomic-embed-text-v1.5")
sentences = ['search_query: What is TSNE?', 'search_query: Who is Laurens van der Maaten?']
embeddings = model.encode(sentences, convert_to_tensor=True)
embeddings = F.layer_norm(embeddings, normalized_shape=(embeddings.shape[1],))
embeddings = embeddings[:, :matryoshka_dim]
embeddings = F.normalize(embeddings, p=2, dim=1)
print(embeddings)| Tool | What it does |
|---|---|
| search_document | Prefix for texts embedded as documents, such as a RAG index |
| search_query | Prefix for texts embedded as questions that documents could answer |
| clustering | Prefix for texts you want to group, find topics in or deduplicate |
| classification | Prefix for texts whose vectors feed a classifier |
You build a question answering app over your own files. You put the document prefix in front of each text chunk and the query prefix in front of each user question, then encode both. Each text comes back as a vector you can compare.
An embedding turns a sentence into a list of numbers, and similar sentences get similar lists. A good first try is to encode one query with its prefix and print the result. Forgetting the prefix is the easiest mistake.
Underneath, the model was trained with Matryoshka representation learning, so the first dimensions carry most of the meaning and you can truncate. The card says it supports sequence lengths past 2048 tokens. The card also names a vision model from the same team that shares this model's vector space.
Turns English text into embedding vectors for search, clustering and classification, and the vectors can be cut to a smaller size. It suits developers building retrieval apps.
Made by nomic-ai on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.
What it is: nomic-embed-text-v1.5 is a text embedding model with 137M parameters. It turns English text into vectors, so you can compare meaning, search documents or group similar texts. Its vectors support Matryoshka resizing, which lets you keep only the first part of each one.
Who it suits: It suits developers and data teams who need text vectors for retrieval, grouping or classification. You need some Python comfort to run it.
Industry | Who uses it | How they use it | Example
Software | Developers of retrieval apps | Embed documents and user questions with different prefixes | A search box over a pile of internal notes
Data science | Analysts | Embed texts to cluster them, find topics or remove near duplicates | Grouping short feedback comments by theme
Machine learning | ML engineers | Use the vectors as input features for a classifier | Training a classifier on top of the embeddings
People who need text in other languages can skip it, since the record lists English only.
Where to use it:
Use case | Who | What they get back
RAG indexing and querying | App developers | Document vectors and matching question vectors
Clustering and deduplication | Analysts | Vectors that group similar texts and expose repeats
Classification features | ML engineers | Vectors a classifier can train on
How to set it up:
pip install -U huggingface_hub
hf download nomic-ai/nomic-embed-text-v1.5
How to use it: Every text you embed must start with a task prefix that tells the model what the vector is for. Add the document prefix to texts you index and the query prefix to questions. Then call encode.
from sentence_transformers import SentenceTransformer
model = SentenceTransformer("nomic-ai/nomic-embed-text-v1.5")
sentences = ['search_query: Who is Laurens van Der Maaten?']
embeddings = model.encode(sentences)
print(embeddings)
To shrink the vectors, the card normalizes them, keeps the first 512 values and normalizes again.
import torch.nn.functional as F
from sentence_transformers import SentenceTransformer
matryoshka_dim = 512
model = SentenceTransformer("nomic-ai/nomic-embed-text-v1.5")
sentences = ['search_query: What is TSNE?', 'search_query: Who is Laurens van der Maaten?']
embeddings = model.encode(sentences, convert_to_tensor=True)
embeddings = F.layer_norm(embeddings, normalized_shape=(embeddings.shape[1],))
embeddings = embeddings[:, :matryoshka_dim]
embeddings = F.normalize(embeddings, p=2, dim=1)
print(embeddings)
Tool | What it does
search_document | Prefix for texts embedded as documents, such as a RAG index
search_query | Prefix for texts embedded as questions that documents could answer
clustering | Prefix for texts you want to group, find topics in or deduplicate
classification | Prefix for texts whose vectors feed a classifier
Example: You build a question answering app over your own files. You put the document prefix in front of each text chunk and the query prefix in front of each user question, then encode both. Each text comes back as a vector you can compare.
For newcomers and experts: An embedding turns a sentence into a list of numbers, and similar sentences get similar lists. A good first try is to encode one query with its prefix and print the result. Forgetting the prefix is the easiest mistake.
Underneath, the model was trained with Matryoshka representation learning, so the first dimensions carry most of the meaning and you can truncate. The card says it supports sequence lengths past 2048 tokens. The card also names a vision model from the same team that shares this model's vector space.
Add a task prefix to each text
Encode the text with the model
Optionally cut vectors to 512 values
Normalize and compare the vectors
Good to know:
Title: Weight size in megabytes
F32: 547 MB
4-bit estimate: 68 MB
Download its files with Hugging Face's command line:
pip install -U huggingface_hub
hf download nomic-ai/nomic-embed-text-v1.5
Then follow the usage in its model card. Nothing in this kit runs by itself.
README.md 6 KB
Listed Hugging Face models in the same category that share the most tags with this one.
| Product | Downloads, last 30 days | Likes | Parameters | License | Last change |
|---|---|---|---|---|---|
| nomic-embed-text-v1.5 This page | 11,809,681 | 994 | 137M | apache-2.0 | |
| bge-small-en-v1.5Shares mteb · model-index · sentence-similarity | 45,750,548 | 671 | 33.4M | mit | |
| bge-base-en-v1.5Shares mteb · model-index · sentence-similarity | 8,508,165 | 542 | 109M | mit | |
| multilingual-e5-largeShares mteb · model-index · sentence-similarity | 7,120,555 | 1,284 | 560M | mit | |
| bge-small-en-v1.5-GGUFShares mteb · model-index · sentence-similarity | 165,239 | 10 | 33.2M | mit | |
| all-MiniLM-L6-v2Shares sentence-similarity · text-embeddings-inference · sentence-transformers | 174,740,184 | 6,104 | 22.7M | apache-2.0 |
Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search and on Trendshift. Mindket doesn’t write or check them. Open one to read it where it was posted.
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
LibertAIDAI · Kit
Runs DeepSeek-V4.1-Flash-1017 as a 2.9 bits-per-weight EXL3 quantization, a 196 GiB copy for people serving large models on their own hardware. Perplexity stay…
facebook · Kit
Generates short music clips from a text description or an audio prompt, in the small checkpoint of facebook's MusicGen. It suits developers and music hobbyists…
alpindale · Kit
Tags every character of C source code for syntax highlighting with a tiny neural network of about 984 weights, run through a small C program. For developers an…
prithivMLmods · Kit
Try a set of LoRAs for the FLUX.2 Klein image model in a Gradio app that runs in your browser or on your own computer. Made for people who make or test AI imag…
Sokheng · Kit
Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…