Bonsai-27B-GGUF
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
Finds the passages that best match a query, using one model that combines token level and whole text matching. An English retrieval model from the University of Innsbruck for people building search.
UIBK-Embedding-v1 is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.
pip install -U huggingface_hub hf download DataScience-UIBK/uibk-embedding-v1
This is a retrieval model for English text. The data science group at the University of Innsbruck trained it starting from ModernBERT-base. Search systems usually choose between a single vector per text and many token vectors per text. This model produces both from one encoder pass and keeps them in a single index, so you run one model instead of two.
Developers and researchers who build search or retrieval over English text, and who already use or want to try PyLate and late interaction retrieval.
| Industry | Who uses it | How they use it | Example |
|---|---|---|---|
| Search engineering | Developers who build document search | Index documents with the model and rank them against queries | Searching a set of support articles with one index instead of two |
| Research | Information retrieval researchers | Compare it with other retrievers on benchmarks such as BEIR | Checking its average score against another ColBERT model |
| Knowledge tools | Teams that build question answering systems | Use it as the retrieval step before an answer is written | Fetching the passages a question refers to |
Skip it if your text is not in English, or if you need a model that writes answers, since this one only ranks text.
The model loads as a PyLate ColBERT model and works with PLAID indexes as they are. The files download on Windows, macOS or Linux.
| Use case | Who | What they get back |
|---|---|---|
| Document retrieval | Search developers | A ranked list of matching passages |
| Benchmark comparison | Researchers | Scores to compare with other retrievers |
| Retrieval for question answering | Application teams | Candidate passages for a later step |
You need Python and the PyLate library. The model files come from Hugging Face.
pip install -U huggingface_hub hf download DataScience-UIBK/uibk-embedding-v1
Load the model in PyLate as you would any ColBERT model, then index your documents and score queries against them. Documents can run to 2048 tokens and queries to 256 tokens.
| Tool | What it does |
|---|---|
| hf download | Fetches the model files to your computer |
| PyLate | Loads the model and scores queries against documents |
| PLAID | Indexes the vectors for fast search |
You index a set of English articles with the model, then search with a question. The ranking comes back from a plain token matching score over one list of vectors, which already includes the whole text score.
If you are new to this, think of it as a way to rank passages by how well they answer a question. Start by indexing a few dozen short English documents and try one query.
If you know the field, each text becomes a set of vectors with 128 dimensions, as in any ColBERT model. Three extra vectors in that list carry the dense embedding, so plain MaxSim equals the token score plus a weighted dense score. The card says it was trained with knowledge distillation from a public cross encoder.
The authors report their own numbers.
| Model | Average |
|---|---|
| UIBK-Embedding-v1 | 59.79 |
| LateOn | 57.22 |
The card adds that this model is larger and reads longer documents than LateOn. LateOn climbs to 57.69 when the authors give it documents of 2048 tokens.
Finds the passages that best match a query, using one model that combines token level and whole text matching. An English retrieval model from the University of Innsbruck for people building search.
Made by DataScience-UIBK on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.
What it is: This is a retrieval model for English text. The data science group at the University of Innsbruck trained it starting from ModernBERT-base. Search systems usually choose between a single vector per text and many token vectors per text. This model produces both from one encoder pass and keeps them in a single index, so you run one model instead of two.
Who it suits: Developers and researchers who build search or retrieval over English text, and who already use or want to try PyLate and late interaction retrieval.
Industry | Who uses it | How they use it | Example
Search engineering | Developers who build document search | Index documents with the model and rank them against queries | Searching a set of support articles with one index instead of two
Research | Information retrieval researchers | Compare it with other retrievers on benchmarks such as BEIR | Checking its average score against another ColBERT model
Knowledge tools | Teams that build question answering systems | Use it as the retrieval step before an answer is written | Fetching the passages a question refers to
Skip it if your text is not in English, or if you need a model that writes answers, since this one only ranks text.
Where to use it: The model loads as a PyLate ColBERT model and works with PLAID indexes as they are. The files download on Windows, macOS or Linux.
Use case | Who | What they get back
Document retrieval | Search developers | A ranked list of matching passages
Benchmark comparison | Researchers | Scores to compare with other retrievers
Retrieval for question answering | Application teams | Candidate passages for a later step
How to set it up: You need Python and the PyLate library. The model files come from Hugging Face.
pip install -U huggingface_hub
hf download DataScience-UIBK/uibk-embedding-v1
How to use it: Load the model in PyLate as you would any ColBERT model, then index your documents and score queries against them. Documents can run to 2048 tokens and queries to 256 tokens.
Tool | What it does
hf download | Fetches the model files to your computer
PyLate | Loads the model and scores queries against documents
PLAID | Indexes the vectors for fast search
Example: You index a set of English articles with the model, then search with a question. The ranking comes back from a plain token matching score over one list of vectors, which already includes the whole text score.
For newcomers and experts: If you are new to this, think of it as a way to rank passages by how well they answer a question. Start by indexing a few dozen short English documents and try one query.
If you know the field, each text becomes a set of vectors with 128 dimensions, as in any ColBERT model. Three extra vectors in that list carry the dense embedding, so plain MaxSim equals the token score plus a weighted dense score. The card says it was trained with knowledge distillation from a public cross encoder.
One encoder pass reads the text
Token vectors and dense vectors form one list
One PLAID index stores the list
Plain MaxSim ranks the results
Good to know: The authors report their own numbers.
Title: BEIR average nDCG@10, 15 datasets
Model | Average
UIBK-Embedding-v1 | 59.79
LateOn | 57.22
The card adds that this model is larger and reads longer documents than LateOn. LateOn climbs to 57.69 when the authors give it documents of 2048 tokens.
Download its files with Hugging Face's command line:
pip install -U huggingface_hub
hf download DataScience-UIBK/uibk-embedding-v1
Then follow the usage in its model card. Nothing in this kit runs by itself.
README.md 5 KB
Listed Hugging Face models in the same category that share the most tags with this one.
| Product | Downloads, last 30 days | Likes | Parameters | License | Last change |
|---|---|---|---|---|---|
| UIBK-Embedding-v1 This page | 2,612 | 11 | 149M | apache-2.0 | |
| hs-embed-1Shares modernbert · sentence-similarity · text-embeddings-inference | 22,412 | 7 | 112M | mit | |
| SPARSEUPShares modernbert · sentence-similarity · text-embeddings-inference | 6,627 | 63 | 188M | apache-2.0 | |
| KURE-Sparse-nanoShares modernbert · text-embeddings-inference · sentence-transformers | 973 | 19 | 149M | apache-2.0 | |
| all-MiniLM-L6-v2Shares sentence-similarity · text-embeddings-inference · sentence-transformers | 174,740,184 | 6,104 | 22.7M | apache-2.0 | |
| bge-small-en-v1.5Shares sentence-similarity · text-embeddings-inference · sentence-transformers | 45,750,548 | 671 | 33.4M | mit |
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
LibertAIDAI · Kit
Runs DeepSeek-V4.1-Flash-1017 as a 2.9 bits-per-weight EXL3 quantization, a 196 GiB copy for people serving large models on their own hardware. Perplexity stay…
facebook · Kit
Generates short music clips from a text description or an audio prompt, in the small checkpoint of facebook's MusicGen. It suits developers and music hobbyists…
alpindale · Kit
Tags every character of C source code for syntax highlighting with a tiny neural network of about 984 weights, run through a small C program. For developers an…
prithivMLmods · Kit
Try a set of LoRAs for the FLUX.2 Klein image model in a Gradio app that runs in your browser or on your own computer. Made for people who make or test AI imag…
Sokheng · Kit
Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…