Bonsai-27B-GGUF
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
Handles computer use, coding and long tool-driven tasks as a multimodal agentic model built on GLM-5.3-Flash, in FP8 weights of about 321B parameters. For teams that can self-host a large model.
Nex-N2.6 is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.
pip install -U huggingface_hub hf download nex-agi/Nex-N2.6
Nex-AGI built Nex-N2.6 on top of GLM-5.3-Flash as a multimodal agent model. It reads images and text and answers in text. Its aims are operating a computer, writing code and handling long jobs where tools get called. This repository holds FP8 weights of about 321B parameters.
It suits teams building agents that operate a computer or call tools, and groups that can host a huge model themselves.
| Industry | Who uses it | How they use it | Example |
|---|---|---|---|
| Software development | Developers | Run it as the model behind a coding or tool-using agent | An agent framework that sends the tools the model may call |
| AI research | Researchers | Compare agentic results on tests such as OSWorld | Checking the reported scores against their own test setup |
| Infrastructure | ML platform teams | Self-host the weights with an FP8-compatible runtime | Serving the model through an SGLang setup |
People without hardware for about 321 GB of weights can skip the download. The card also points to an API on OpenRouter.
| Use case | Who | What they get back |
|---|---|---|
| Computer use | Agent builders | A model tuned for tasks on a computer, scored on OSWorld |
| Coding | Developers | Code written on request, such as a short Python function |
| Tool-using tasks | Agent teams | Tool calls that stay within the tools declared in the request |
You need these first:
pip install -U huggingface_hub hf download nex-agi/Nex-N2.6
The served model name is set with this flag.
--served-model-name Nex-N2.6
Once the OpenAI-compatible server listens on port 8000, send it chat requests with the model name Nex-N2.6. A few request settings matter:
You send a chat request asking, "Write me a Python function that tests whether some text reads the same backward," with reasoning_effort set to max. The reply streams back with the function.
If you are new to this, know that it is a huge model meant for servers, not a laptop. A small first step is to read the card and decide whether to use the hosted API on OpenRouter or to host the weights yourself.
If you work in the field, this release follows Nex-N2.5-Pro and aims at less repetitive reasoning and closer adherence to the tools in the current environment. The team reports reasoning repetition falling from 16.0% to 1.6% in its internal replay evaluation, and 100% tool-list adherence among responses that make tool calls. The team says its scores depend on the evaluation setup and refer to the model overall, not to this FP8 copy on its own. On Terminal-Bench 2.1 and AutomationBench the table shows it below GLM-5.3-Flash.
The team reports these OSWorld scores for this release and its comparison models.
Handles computer use, coding and long tool-driven tasks as a multimodal agentic model built on GLM-5.3-Flash, in FP8 weights of about 321B parameters. For teams that can self-host a large model.
Made by nex-agi on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.
What it is: Nex-AGI built Nex-N2.6 on top of GLM-5.3-Flash as a multimodal agent model. It reads images and text and answers in text. Its aims are operating a computer, writing code and handling long jobs where tools get called. This repository holds FP8 weights of about 321B parameters.
Who it suits: It suits teams building agents that operate a computer or call tools, and groups that can host a huge model themselves.
Title: Who might use it
Industry | Who uses it | How they use it | Example
Software development | Developers | Run it as the model behind a coding or tool-using agent | An agent framework that sends the tools the model may call
AI research | Researchers | Compare agentic results on tests such as OSWorld | Checking the reported scores against their own test setup
Infrastructure | ML platform teams | Self-host the weights with an FP8-compatible runtime | Serving the model through an SGLang setup
People without hardware for about 321 GB of weights can skip the download. The card also points to an API on OpenRouter.
Where to use it:
Title: Jobs it does
Use case | Who | What they get back
Computer use | Agent builders | A model tuned for tasks on a computer, scored on OSWorld
Coding | Developers | Code written on request, such as a short Python function
Tool-using tasks | Agent teams | Tool calls that stay within the tools declared in the request
How to set it up: You need these first:
pip install -U huggingface_hub
hf download nex-agi/Nex-N2.6
The served model name is set with this flag.
--served-model-name Nex-N2.6
How to use it: Once the OpenAI-compatible server listens on port 8000, send it chat requests with the model name Nex-N2.6. A few request settings matter:
Example: You send a chat request asking, "Write me a Python function that tests whether some text reads the same backward," with reasoning_effort set to max. The reply streams back with the function.
For newcomers and experts: If you are new to this, know that it is a huge model meant for servers, not a laptop. A small first step is to read the card and decide whether to use the hosted API on OpenRouter or to host the weights yourself.
If you work in the field, this release follows Nex-N2.5-Pro and aims at less repetitive reasoning and closer adherence to the tools in the current environment. The team reports reasoning repetition falling from 16.0% to 1.6% in its internal replay evaluation, and 100% tool-list adherence among responses that make tool calls. The team says its scores depend on the evaluation setup and refer to the model overall, not to this FP8 copy on its own. On Terminal-Bench 2.1 and AutomationBench the table shows it below GLM-5.3-Flash.
Download the FP8 weights
Serve them with an FP8-capable runtime
Send OpenAI-style chat requests on port 8000
Supply tools, your client runs the calls
Good to know: The team reports these OSWorld scores for this release and its comparison models.
Title: OSWorld score reported by the team
Nex-N2.6: 83.0 points
Nex-N2.5-Pro: 82.2 points
GLM-5.3-Flash: 78.0 points
DeepSeek-V4.1-Flash: 71.7 points
Download its files with Hugging Face's command line:
pip install -U huggingface_hub
hf download nex-agi/Nex-N2.6
Then follow the usage in its model card. Nothing in this kit runs by itself.
README.md 6 KB
Listed Hugging Face models in the same category that share the most tags with this one.
| Product | Downloads, last 30 days | Likes | Parameters | License | Last change |
|---|---|---|---|---|---|
| Nex-N2.6 This page | 191 | 60 | 321B | apache-2.0 | |
| GLM-5.3-FlashShares glm5_next · fp8 · image-text-to-text | 6,397,774 | 3,138 | 321B | mit | |
| GLM-5.3-Flash-BF16Shares glm5_next · image-text-to-text · conversational | 68,087 | 85 | 321B | mit | |
| GLM-5.3-Flash EXL3 SparkShares glm5_next · image-text-to-text · conversational | 399 | 11 | 48B | mit | |
| Qwen3.8-27B-FP8Shares fp8 · image-text-to-text · conversational | 5,442,810 | 984 | 27.8B | apache-2.0 | |
| Qwen3.6-35B-A3B-FP8Shares fp8 · image-text-to-text · conversational | 3,818,590 | 448 | 36B | apache-2.0 |
Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search and on Trendshift. Mindket doesn’t write or check them. Open one to read it where it was posted.
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
LibertAIDAI · Kit
Runs DeepSeek-V4.1-Flash-1017 as a 2.9 bits-per-weight EXL3 quantization, a 196 GiB copy for people serving large models on their own hardware. Perplexity stay…
facebook · Kit
Generates short music clips from a text description or an audio prompt, in the small checkpoint of facebook's MusicGen. It suits developers and music hobbyists…
alpindale · Kit
Tags every character of C source code for syntax highlighting with a tiny neural network of about 984 weights, run through a small C program. For developers an…
prithivMLmods · Kit
Try a set of LoRAs for the FLUX.2 Klein image model in a Gradio app that runs in your browser or on your own computer. Made for people who make or test AI imag…
Sokheng · Kit
Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…