Bonsai-27B-GGUF
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
Generates text with a compact 1.7B model for on-device use, with three adjustable thinking levels. Suits developers who want coding, agent and long-context help on local hardware.
Spark-X2.6-1.7B is a kit in the Developer category, listed by Mindket. It is free. This is version 1, last updated on . Download it on this page, a zip of its files. Nothing in it runs by itself.
pip install -U huggingface_hub hf download XHToken/Spark-X2.6-1.7B
Spark-X2.6-1.7B is a compact language model for English and Chinese, built to run on local devices. The series began with a 4B release, and this 1.7B model is the next one. It keeps the architecture of Spark-X2.5-1.7B and gets its gains from better post-training in coding, agent work, long contexts, multilingual use and reasoning.
Developers who want a small, fast model on a laptop or an edge device, and who like to set how much the model thinks.
| Industry | Who uses it | How they use it | Example |
|---|---|---|---|
| Software | Developers | Run a small coding and agent model on local hardware | Add a local assistant to a desktop tool |
| Mobile and edge | Device builders | Put an on-device language model in an app | Answer questions without a server |
| Education | Learners | Try a modern small model on a normal computer | Ask it a question in Chinese or English |
If you need the strongest answers and have a big GPU, you can skip it.
| Use case | Who | What they get back |
|---|---|---|
| Coding help | Developers | Code and fixes from a small model |
| Agent tasks | Agent builders | Multi-step planning and tool use |
| Long-context reading | Analysts | Answers drawn from a long input |
pip install -U huggingface_hub hf download XHToken/Spark-X2.6-1.7B
pip install transformers==4.57.1
Load the tokenizer and the model, then send a chat message through the chat template. The card lets you choose one of three thinking levels, none, low or high, to trade quality against speed and cost.
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "XHToken/Spark-X2.6-1.7B"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id,
trust_remote_code=True,
torch_dtype="auto",
device_map="auto",
)| Tool | What it does |
|---|---|
| AutoTokenizer | Loads the tokenizer and applies the chat template |
| AutoModelForCausalLM | Loads the model and generates replies |
| Thinking level | Chooses none, low or high reasoning effort |
You ask it a short factual question in a chat message. The model replies in text, and with a lower thinking level the reply is shorter and quicker.
If you are new, load the model with the snippet above and send one short question. Try the low thinking level when speed matters.
The card compares thinking levels directly. Going from high to low lowers the average score by 4.0 points and cuts the average output length by 37.3 percent. The model reuses the Spark-X2.5-1.7B architecture, so the changes come from post-training rather than from new layers.
Generates text with a compact 1.7B model for on-device use, with three adjustable thinking levels. Suits developers who want coding, agent and long-context help on local hardware.
Made by XHToken on Hugging Face. These notes are Mindket's, written from its model page and model card; the model's own files and license are on Hugging Face.
What it is: Spark-X2.6-1.7B is a compact language model for English and Chinese, built to run on local devices. The series began with a 4B release, and this 1.7B model is the next one. It keeps the architecture of Spark-X2.5-1.7B and gets its gains from better post-training in coding, agent work, long contexts, multilingual use and reasoning.
Who it suits: Developers who want a small, fast model on a laptop or an edge device, and who like to set how much the model thinks.
Industry | Who uses it | How they use it | Example
Software | Developers | Run a small coding and agent model on local hardware | Add a local assistant to a desktop tool
Mobile and edge | Device builders | Put an on-device language model in an app | Answer questions without a server
Education | Learners | Try a modern small model on a normal computer | Ask it a question in Chinese or English
If you need the strongest answers and have a big GPU, you can skip it.
Where to use it:
Use case | Who | What they get back
Coding help | Developers | Code and fixes from a small model
Agent tasks | Agent builders | Multi-step planning and tool use
Long-context reading | Analysts | Answers drawn from a long input
How to set it up:
pip install -U huggingface_hub
hf download XHToken/Spark-X2.6-1.7B
pip install transformers==4.57.1
How to use it: Load the tokenizer and the model, then send a chat message through the chat template. The card lets you choose one of three thinking levels, none, low or high, to trade quality against speed and cost.
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "XHToken/Spark-X2.6-1.7B"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id,
trust_remote_code=True,
torch_dtype="auto",
device_map="auto",
)
Tool | What it does
AutoTokenizer | Loads the tokenizer and applies the chat template
AutoModelForCausalLM | Loads the model and generates replies
Thinking level | Chooses none, low or high reasoning effort
Example: You ask it a short factual question in a chat message. The model replies in text, and with a lower thinking level the reply is shorter and quicker.
For newcomers and experts: If you are new, load the model with the snippet above and send one short question. Try the low thinking level when speed matters.
The card compares thinking levels directly. Going from high to low lowers the average score by 4.0 points and cuts the average output length by 37.3 percent. The model reuses the Spark-X2.5-1.7B architecture, so the changes come from post-training rather than from new layers.
Load the tokenizer and model
Build chat messages
Pick a thinking level
Generate and read the reply
Good to know:
Title: Switching from high to low reasoning effort
Average score drop: 4.0 points
Average output length drop: 37.3 percent
Download its files with Hugging Face's command line:
pip install -U huggingface_hub
hf download XHToken/Spark-X2.6-1.7B
Then follow the usage in its model card. Nothing in this kit runs by itself.
README.md 5 KB
Listed Hugging Face models in the same category that share the most tags with this one.
| Product | Downloads, last 30 days | Likes | Parameters | License | Last change |
|---|---|---|---|---|---|
| Spark-X2.6-1.7B This page | 5,095 | 84 | 1.7B | apache-2.0 | |
| Spark-X2.6-4BShares sparkx2_5 · spark2_5 · text-generation | 28,117 | 1,041 | 4.1B | apache-2.0 | |
| Spark-X2.5-4BShares sparkx2_5 · spark2_5 · text-generation | 8,697 | 1,442 | 4.1B | apache-2.0 | |
| Spark-X2.6-4B-BaseShares sparkx2_5 · spark2_5 · text-generation | 2,331 | 47 | 4.1B | apache-2.0 | |
| Spark-X2.6-4B-FP8Shares sparkx2_5 · spark2_5 · text-generation | 2,048 | 39 | 4.1B | apache-2.0 | |
| Spark-X2.6-1.7B-BaseShares sparkx2_5 · spark2_5 · text-generation | 1,272 | 15 | 1.7B | apache-2.0 |
Posts and comments that name this project on Hacker News, Bluesky, X, Reddit, Facebook and YouTube, found by a weekly search and on Trendshift. Mindket doesn’t write or check them. Open one to read it where it was posted.
lmstudio-community · Kit
A GGUF conversion of the 27B Bonsai model for LM Studio, with a 3.80 GB Q1_0 language file and a 0.93 GB BF16 vision projector. Tested for text, vision and par…
LibertAIDAI · Kit
Runs DeepSeek-V4.1-Flash-1017 as a 2.9 bits-per-weight EXL3 quantization, a 196 GiB copy for people serving large models on their own hardware. Perplexity stay…
facebook · Kit
Generates short music clips from a text description or an audio prompt, in the small checkpoint of facebook's MusicGen. It suits developers and music hobbyists…
alpindale · Kit
Tags every character of C source code for syntax highlighting with a tiny neural network of about 984 weights, run through a small C program. For developers an…
prithivMLmods · Kit
Try a set of LoRAs for the FLUX.2 Klein image model in a Gradio app that runs in your browser or on your own computer. Made for people who make or test AI imag…
Sokheng · Kit
Reads Khmer and English text from documents, receipts and photos of signs, using a detector for text lines and a recogniser for each line. Suits developers who…