Bonsai-27B-GGUF
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
A 20B-parameter search model that finds supporting documents for complex, multi-step questions and trims its own working context as it goes. Meant to act as a retrieval helper next to a larger reasoning model.
Chroma Context-1 is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.
pip install -U huggingface_hub hf download chromadb/context-1
Chroma Context-1 is a search model built on openai/gpt-oss-20b. It takes a hard question, splits it into smaller queries, searches a document collection step by step, and gathers the documents that support an answer.
It is meant to work as a retrieval subagent beside a larger reasoning model. While it searches, it drops documents it no longer needs, which leaves room in its context for more searching.
Developers who build retrieval or research agents and want a dedicated search step in front of a main reasoning model. It also interests researchers who read how agentic search is trained.
| Industry | Who uses it | How they use it | Example |
|---|---|---|---|
| AI engineering | Agent builders | Add a search subagent that feeds a main model | A research agent that gathers sources before it answers |
| Legal | Legal tech developers | Retrieve supporting documents for multi-part questions | Finding documents that satisfy several stated conditions |
| Finance | Analytics teams | Search large document sets for related evidence | Collecting filings that bear on one question |
| Research | ML researchers | Study a self-editing search agent | Reading the technical report and comparing setups |
Anyone who wants a model that runs from a few lines of code can wait, since it expects a specific agent framework that is not yet public.
| Use case | Who | What they get back |
|---|---|---|
| Multi-step retrieval | Agent developers | Supporting documents for a complex question |
| Query breakdown | Search engineers | A hard question split into targeted subqueries |
| Long searches | Research teams | Retrieval quality kept up by pruning irrelevant documents |
You need Python and a machine that can hold a 20B model.
pip install -U huggingface_hub hf download chromadb/context-1
The card shows no run command. The model is trained for a specific framework that runs the tools, budgets tokens, prunes context and removes duplicates, and results reported in the technical report depend on it.
In day-to-day use the framework hands the model a query, the model decomposes it, calls search tools, often several at once, and returns the documents it found.
A person gives the agent a question with several conditions that no single search can answer. Context-1 breaks it into separate subqueries, searches the corpus for each, drops documents that do not help, and returns supporting documents for the main model to use.
If you are new, think of it as a research assistant that only finds sources. It does not write the final answer. The first small step is to read the technical report and download the files, because running it well needs the framework.
For experts, it is a mixture-of-experts model trained with supervised fine-tuning and then reinforcement learning with CISPO on a staged curriculum. The card reports an average of 2.56 tool calls per turn and a prune accuracy of 0.94. It says retrieval is comparable to frontier models at lower cost and up to 10 times faster, which are the authors' own claims.
The points below cover limits and costs.
A 20B-parameter search model that finds supporting documents for complex, multi-step questions and trims its own working context as it goes. Meant to act as a retrieval helper next to a larger reasoning model.
Made by chromadb on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.
What it is: Chroma Context-1 is a search model built on openai/gpt-oss-20b. It takes a hard question, splits it into smaller queries, searches a document collection step by step, and gathers the documents that support an answer.
It is meant to work as a retrieval subagent beside a larger reasoning model. While it searches, it drops documents it no longer needs, which leaves room in its context for more searching.
Who it suits: Developers who build retrieval or research agents and want a dedicated search step in front of a main reasoning model. It also interests researchers who read how agentic search is trained.
Industry | Who uses it | How they use it | Example
AI engineering | Agent builders | Add a search subagent that feeds a main model | A research agent that gathers sources before it answers
Legal | Legal tech developers | Retrieve supporting documents for multi-part questions | Finding documents that satisfy several stated conditions
Finance | Analytics teams | Search large document sets for related evidence | Collecting filings that bear on one question
Research | ML researchers | Study a self-editing search agent | Reading the technical report and comparing setups
Anyone who wants a model that runs from a few lines of code can wait, since it expects a specific agent framework that is not yet public.
Where to use it:
Use case | Who | What they get back
Multi-step retrieval | Agent developers | Supporting documents for a complex question
Query breakdown | Search engineers | A hard question split into targeted subqueries
Long searches | Research teams | Retrieval quality kept up by pruning irrelevant documents
How to set it up: You need Python and a machine that can hold a 20B model.
pip install -U huggingface_hub
hf download chromadb/context-1
How to use it: The card shows no run command. The model is trained for a specific framework that runs the tools, budgets tokens, prunes context and removes duplicates, and results reported in the technical report depend on it.
In day-to-day use the framework hands the model a query, the model decomposes it, calls search tools, often several at once, and returns the documents it found.
Example: A person gives the agent a question with several conditions that no single search can answer. Context-1 breaks it into separate subqueries, searches the corpus for each, drops documents that do not help, and returns supporting documents for the main model to use.
For newcomers and experts: If you are new, think of it as a research assistant that only finds sources. It does not write the final answer. The first small step is to read the technical report and download the files, because running it well needs the framework.
For experts, it is a mixture-of-experts model trained with supervised fine-tuning and then reinforcement learning with CISPO on a staged curriculum. The card reports an average of 2.56 tool calls per turn and a prune accuracy of 0.94. It says retrieval is comparable to frontier models at lower cost and up to 10 times faster, which are the authors' own claims.
A complex query arrives
The model splits it into subqueries
It searches the corpus with parallel tool calls
It prunes documents that do not help
Supporting documents go to the main model
Good to know: The points below cover limits and costs.
Download its files with Hugging Face's command line:
pip install -U huggingface_hub
hf download chromadb/context-1
Then follow the usage in its model card. Nothing in this kit runs by itself.
README.md 6 KB
Listed Hugging Face models in the same category that share the most tags with this one.
| Product | Downloads, last 30 days | Likes | Parameters | License | Last change |
|---|---|---|---|---|---|
| Chroma Context-1 This page | 613 | 425 | 20.9B | apache-2.0 | |
| gpt-oss-20bShares gpt_oss · text-generation · conversational | 5,685,450 | 5,299 | 20.9B | apache-2.0 | |
| gpt-oss-120bShares gpt_oss · text-generation · conversational | 2,435,242 | 5,509 | 117B | apache-2.0 | |
| gpt-oss-safeguard-20bShares gpt_oss · text-generation · conversational | 24,325 | 293 | 21.5B | apache-2.0 | |
| gpt-oss-safeguard-120bShares gpt_oss · text-generation · conversational | 16,400 | 128 | 117B | apache-2.0 | |
| gpt-oss-20b-GGUFShares gpt_oss · text-generation · conversational | 614,134 | 909 | 20.9B | apache-2.0 |
Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search and on Trendshift. Mindket doesn’t write or check them. Open one to read it where it was posted.
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
LibertAIDAI · Kit
Runs DeepSeek-V4.1-Flash-1017 as a 2.9 bits-per-weight EXL3 quantization, a 196 GiB copy for people serving large models on their own hardware. Perplexity stay…
facebook · Kit
Generates short music clips from a text description or an audio prompt, in the small checkpoint of facebook's MusicGen. It suits developers and music hobbyists…
alpindale · Kit
Tags every character of C source code for syntax highlighting with a tiny neural network of about 984 weights, run through a small C program. For developers an…
prithivMLmods · Kit
Try a set of LoRAs for the FLUX.2 Klein image model in a Gradio app that runs in your browser or on your own computer. Made for people who make or test AI imag…
Sokheng · Kit
Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…