Bonsai-27B-GGUF
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
A small weight edit for Qwen3.8-27B, with a script that applies it, that cuts the model's thinking length on open-ended tasks by changing a single matrix, with no training.
Qwen3.8-27B Astra stop edit is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.
pip install torch safetensors numpy huggingface_hub python apply.py --out ./Qwen3.8-27B-Astra
Qwen3.8-27B Astra stop edit is a tiny change to the weights of Qwen3.8-27B. It makes the model think for fewer tokens before it answers an open-ended request. The card's test case is drawing a pelican on a bicycle as an SVG. The edit is about 20 KB, and it involves no training or fine-tuning.
Only one matrix changes, the MLP output of the last layer. That is 89.1M weights, or 0.32 percent of the model, and their values shift by 1.4 percent.
It suits researchers and tinkerers who like weight-space experiments, and people who run Qwen3.8-27B and want shorter reasoning on creative tasks. The card says an AI agent found the edit by running its own experiments on the weights.
| Industry | Who uses it | How they use it | Example |
|---|---|---|---|
| Research | ML researchers | Study editing weights directly instead of training | Reading how one direction controls stopping |
| Software | Developers | Cut thinking cost on open-ended generation | Drawing an SVG with fewer thinking tokens |
| Inference tuning | Local model users | Apply a small patch to a model they already run | Rebuilding a model folder in seconds |
| Education | Students of model internals | See how a single matrix changes behavior | Comparing the original and edited model |
Skip it if you need big gains on maths or code. The card says thinking is barely shorter there.
| Use case | Who | What they get back |
|---|---|---|
| Shorter thinking | Model users | About 40 percent fewer thinking tokens on the card's pelican test |
| Same accuracy | Developers | 95.2 percent on maths and code, the same as the original |
| Weight-space study | Researchers | A one-direction edit that you can read and reproduce |
You need a few things in place first.
pip install torch safetensors numpy huggingface_hub python apply.py --out ./Qwen3.8-27B-Astra
The script downloads the original model, checks the single file it will edit and rewrites it. The rest of the files stay as they were, linked or copied across. If you already have the original model, you can point the script at it with the model flag.
| Tool | What it does |
|---|---|
| apply.py | Applies the edit and writes the output folder |
| u.npy | Holds the edit direction, 5,120 numbers in float32 |
| edit.json | Describes the edit: the target tensor, its strength and the base model version |
You run the apply command with an output folder named Qwen3.8-27B-Astra. A few seconds later the folder holds the edited model. You load it as you would the original and ask it to draw a pelican riding a bicycle as an SVG. The card reports about 40 percent less thinking on that task.
Treat this as a curious experiment. If you want to try it, run the script, then compare the edited model with the original on one creative prompt.
The direction nearly matches the output-head row for the end-of-thinking token, with a cosine of 0.995. The edit doubles the last layer's push along that signal, so the model decides to stop sooner. Stronger edits hurt, since at three times the strength accuracy falls to 44 percent. The pelican test used 16 tries on each side, which the card calls a small sample.
A small weight edit for Qwen3.8-27B, with a script that applies it, that cuts the model's thinking length on open-ended tasks by changing a single matrix, with no training.
Made by jarrodwatts on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.
What it is: Qwen3.8-27B Astra stop edit is a tiny change to the weights of Qwen3.8-27B. It makes the model think for fewer tokens before it answers an open-ended request. The card's test case is drawing a pelican on a bicycle as an SVG. The edit is about 20 KB, and it involves no training or fine-tuning.
Only one matrix changes, the MLP output of the last layer. That is 89.1M weights, or 0.32 percent of the model, and their values shift by 1.4 percent.
Who it suits: It suits researchers and tinkerers who like weight-space experiments, and people who run Qwen3.8-27B and want shorter reasoning on creative tasks. The card says an AI agent found the edit by running its own experiments on the weights.
Industry | Who uses it | How they use it | Example
Research | ML researchers | Study editing weights directly instead of training | Reading how one direction controls stopping
Software | Developers | Cut thinking cost on open-ended generation | Drawing an SVG with fewer thinking tokens
Inference tuning | Local model users | Apply a small patch to a model they already run | Rebuilding a model folder in seconds
Education | Students of model internals | See how a single matrix changes behavior | Comparing the original and edited model
Skip it if you need big gains on maths or code. The card says thinking is barely shorter there.
Where to use it:
Use case | Who | What they get back
Shorter thinking | Model users | About 40 percent fewer thinking tokens on the card's pelican test
Same accuracy | Developers | 95.2 percent on maths and code, the same as the original
Weight-space study | Researchers | A one-direction edit that you can read and reproduce
How to set it up: You need a few things in place first.
pip install torch safetensors numpy huggingface_hub
python apply.py --out ./Qwen3.8-27B-Astra
How to use it: The script downloads the original model, checks the single file it will edit and rewrites it. The rest of the files stay as they were, linked or copied across. If you already have the original model, you can point the script at it with the model flag.
Tool | What it does
apply.py | Applies the edit and writes the output folder
u.npy | Holds the edit direction, 5,120 numbers in float32
edit.json | Describes the edit: the target tensor, its strength and the base model version
Example: You run the apply command with an output folder named Qwen3.8-27B-Astra. A few seconds later the folder holds the edited model. You load it as you would the original and ask it to draw a pelican riding a bicycle as an SVG. The card reports about 40 percent less thinking on that task.
For newcomers and experts: Treat this as a curious experiment. If you want to try it, run the script, then compare the edited model with the original on one creative prompt.
The direction nearly matches the output-head row for the end-of-thinking token, with a cosine of 0.995. The edit doubles the last layer's push along that signal, so the model decides to stop sooner. Stronger edits hurt, since at three times the strength accuracy falls to 44 percent. The pelican test used 16 tries on each side, which the card calls a small sample.
Title: Mean thinking tokens on the pelican test, from the card
Original model: 28474 tokens
Edited model: 17201 tokens
Run the apply script
It checks the one file to edit
It rewrites that file and links the rest
Load the output folder like the original
Good to know:
Download its files with Hugging Face's command line:
pip install -U huggingface_hub
hf download jarrodwatts/Qwen3.8-27B-Astra-Stop
Then follow the usage in its model card. Nothing in this kit runs by itself.
README.md 5 KB
Listed Hugging Face models in the same category that share the most tags with this one.
| Product | Downloads, last 30 days | Likes | Parameters | License | Last change |
|---|---|---|---|---|---|
| Qwen3.8-27B Astra stop edit This page | 0 | 11 | — | apache-2.0 | |
| Qwen3.5-0.8B Astra Weight EditShares weight-editing · weight-space-programming | 3,029 | 27 | 873M | apache-2.0 | |
| Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled-GGUFShares qwen · reasoning | 39,987 | 188 | 4.2B | apache-2.0 | |
| Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUFShares qwen · reasoning | 17,179 | 296 | 34.7B | apache-2.0 | |
| Qwen3.8-Whittle-MoE-27B-MLX-4bitShares qwen · reasoning | 1,611 | 11 | 26.9B | apache-2.0 | |
| Qwen3.5-0.8B-weight-space-programming-GGUFShares weight-space-programming | 4,807 | 10 | 752M | apache-2.0 |
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
LibertAIDAI · Kit
Runs DeepSeek-V4.1-Flash-1017 as a 2.9 bits-per-weight EXL3 quantization, a 196 GiB copy for people serving large models on their own hardware. Perplexity stay…
facebook · Kit
Generates short music clips from a text description or an audio prompt, in the small checkpoint of facebook's MusicGen. It suits developers and music hobbyists…
alpindale · Kit
Tags every character of C source code for syntax highlighting with a tiny neural network of about 984 weights, run through a small C program. For developers an…
prithivMLmods · Kit
Try a set of LoRAs for the FLUX.2 Klein image model in a Gradio app that runs in your browser or on your own computer. Made for people who make or test AI imag…
Sokheng · Kit
Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…